338. Diversifying the Education Pipeline

Diversifying various fields and disciplines requires intentional work to create and support a pipeline of practitioners. In this episode, Laura Spenceley joins us to discuss specific initiatives to increase inclusion in the PK-12 sector. Laura is the Dean of the School of Education here at SUNY Oswego. She is an Impact Academy Fellow through the national non-profit organization Deans for Impact which works to strengthen and diversify the educator workforce.

Transcript

John: Diversifying various fields and disciplines requires intentional work to create and support a pipeline of practitioners. In this episode, we talk about specific initiatives to increase inclusion in the PK-12 sector

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Laura Spenceley. Laura is the Dean of the School of Education here at SUNY Oswego. She is an Impact Academy Fellow through the national non-profit organization Deans for Impact which works to strengthen and diversify the educator workforce. Welcome, Laura.

Laura: So great to be with you two today. I’m really excited for our conversation.

John: It’s overdue. We’re really happy to be talking to you today. And we’re talking to you from a new room which the School of Education has graciously loaned to us because we lost our old recording space, and we’re now able to keep the podcast going. So thank you.

Laura: You’re most welcome. And truly, I can’t think of a more symbiotic relationship between Tea for Teaching, the opportunity to host you here in the School of Education, and continue this great work and digging into pedagogy issues across the education continuum. And having you right here in-house makes a lot of sense.

John: Our teas today are:… Laura, are you drinking any tea?

Laura: I am not a tea drinker. But I do have a robust French roast in my mug today.

Rebecca: A popular flavor of tea, as we’ve noted multiple times here on the podcast. I have Hunan Jig today, John, I thought it was a good celebratory sounding tea.

John: And I have a spring cherry green tea in a brand new School of Education mug, which I just received today. Thank you.

Laura: You’re welcome.

Rebecca: In your role as the Dean of the School of Education, you’re involved in the entire P-20 pathway. The School of Education has received two large grants to help support students pursuing careers in education. Could you tell us a little bit about these grants?

Laura: I’m thrilled to talk more about these opportunities. And these two projects are our teacher opportunity core grant, that’s our TOC grant and our Cultivating Representation in School Psychology grant. Both of these grants are, as their name may imply, designed to help us recruit, support, retain and move through into careers, teachers and school psychologists from a wide range of backgrounds. It’s a well known fact across most educational spaces that folks who are delivering instruction or providing support services don’t always represent the constituent student populations with whom they work. And each of these programs are designed to 1. help ensure that we have a representative and diverse education workforce. But more importantly than that, they’re also designed to ensure that as we recruit and matriculate students into our teacher preparation programs and school psychology program, that we’re investing in those candidates along the way, recognizing that students from historically marginalized groups are often more likely to have challenges in persisting through their academic programs, both undergraduate and graduate. So each of these programs has some similar foundational elements. That includes financial support along the continuum of their educational program, again, undergraduate or graduate, support for things like transportation, professional development opportunities. And those professional development opportunities are really designed to empower our students from those historically marginalized or underrepresented spaces in their fields with contemporary activities that will help them address systemic discrepancies in schools. So making classrooms more responsive to the needs of the multicultural communities in which they reside, helping ensure that our future psychologists and educators have opportunities to work with people along the way that look like them, that share their lived experiences, and build that really continuum of care around their success. It’s also a great opportunity for us as educators, leaders, teachers, to be invested in those spaces with them and hearing from their mouths, what their challenges are, what their opportunities are in districts and really working to empower them for a career in education.

John: And the School of Education has always been engaged in working with students from all these marginalized groups that you’ve mentioned. What other types of support, though, have you been working on developing in the School of Ed for students who are first-gen students, Pell-eligible students, or from historically minoritized groups?

Laura: It’s a great question, John, and I’m so thankful to have the opportunity to chat about it because I think sometimes, as is human nature, we want to create responses or programming from a perspective of “all first gen-students might need this thing” or “all Pell-eligible students might need this thing” and we’ve been certainly sensitive to the realities that those populations experience, but also have tried to take a step back and take a more nuanced approach to that work. I’ve had the opportunity to be in the Dean’s position for about three years now. And when I came in the door, it was the year after the global pandemic. And so, so much of what we knew here on a college campus and in our P-12 spaces in the community had just been turned on its head. So when I came into the dean’s office, one of the things that was really important was to hear from our students, our candidates pursuing their degrees, what are the challenges that you’re experiencing? And I need to give a shout out to Dr. Nicole Brown, our director of our clinical practice and partnerships office, she really had this vision of surveying students, engaging in some listening sessions with those students. And we took the opportunity to deploy a survey about how students were experiencing their programs, but also the challenges that they were experiencing. And those data were humbling, to say the least. We learned back in 2021-22, about one in five of our students was having to make the choice between eating and paying for gas to get to their placements. About one in four of our students had to go without a meal at a certain point so that they would be able to engage. We recognize, and this was not a new problem, but just how challenging transportation to and from their clinical sites was becoming particularly in a time where we were very sensitive to being in enclosed spaces. And so we took that opportunity to reflect on the ways we weren’t just to use quotes, “utilizing the resources,” like our teacher opportunity core program, but to really recalibrate the way we were engaging with all students. And so what that looks like right now is we’ve really taken an approach to engage with our students from the time they’re prospective students all the way through graduation and career placement. And so what that has looked like is we’ve had active faculty and administrator presence at recruitment events, helping prospective students and their families understand not just the phenomenal financial aid resources available to them, but demystifying grant programs like the Teach Grant program, like public service loan forgiveness, which is available to many of our graduates after a period of time, it’s also about helping those families understand what contemporary classrooms and contemporary educational careers look like. There’s so much animus in public media and in the dialogue around what’s going on in schools and giving our prospective students the opportunity to hear from our current students and our partners, what they can actually expect, not just out of their degree program, but the field, has been really impactful. On a more nuanced level, as a result of that survey, we have utilized a range of resources to help offset some of those specific concerns regarding transportation, costs related to certification, and food instability. I do need to call out our amazing student affairs team on campus that has made enormous investments in this space as well. And I think always connecting students to the most local resources has been a really effective way to ensure they can take advantage of those supports in a way that makes sense to them. For us, I was lucky enough to inherit a 12-passenger van that had been purchased right before the pandemic, and we’ve taken the opportunity to hire student drivers. We offer daily routes to and from the Syracuse area at no cost to our students, leveraging the generosity of our alumni and donors who have invested in the School of Education, we have made a commitment for any candidate that needs to get to or from their site and can’t use the van, that we’ve created an Uber voucher system. And so we’ve been able to put those funds directly in front of students. We’ve expanded our supports for certification exams and fingerprinting through really simply asking students: “Are these barriers?” and creating a process again, through our foundation funds, that we’ve been able to offset those costs in time of need. And then lastly, I think another part of this is helping our faculty understand the realities that our candidates are experiencing as they move through their degree programs. Bringing those data back from not just the survey but listening sessions we continue to offer as an open forum for students to share their concerns, bringing that back to our faculty and helping them understand in both a formative and accurate sort of way, what the experiences of our students are in looking to make changes, whether it’s to our core sequences, the way that we administer fees, encouraging open-access resources, building resource libraries within our departments, so that we can continue to wrap our arms around students, give them a great experience, and also ensure that something like a meal isn’t getting in the way of their ability to get to and from their site.

John: And one thing we should note is that Syracuse is about 40 miles or so from here. So the commute time for a student would probably be about 45 minutes to 55 minutes, depending on where the school is located. So transportation would be relatively expensive for students.

Laura: Yes, and it’s such a good point to make, and I know we’re likely to talk about partnerships later, being where we are here in Oswego, we are lucky enough to have amazing partners along the I-81 corridor from Syracuse to Oswego, almost to Utica, almost to Rochester. And so it is not unusual that our candidates are driving up to an hour each way. So absolutely.

Rebecca: And it’s a problem that campuses that are in a more rural context experience when they’re doing any kind of placements, whether it’s internships, student teaching, or service learning, or anything like that. It’s very different than an urban context.

Laura: Absolutely. And I think we’re really committed, we embrace the idea that we are a rural educator preparation program, while also embracing the fact we have large urban partners just down the road. And we see that as an opportunity to diversify our candidates’ experience and give them a broad sampling of school structures, organizations, what’s possible, both in large districts, small and the in-betweens. And so that’s been a really critical part of our preparation framework for many, many years here in the School of Education.

Rebecca: It’s always great to hear stories, and we’ve heard more of these since COVID, of schools really paying attention to the actual needs of students and what barriers they’re facing, and really being responsive to them and finding ways to solve the barriers that they’re facing. Because often, the barriers are great, but often there are solutions that we can put into place that aren’t actually that complicated when we get down to what they are.

Laura: Rebecca, I love so much how you framed that, because one of the driving mantras that I often remind myself is we can solve problems if we choose to. And I think to solve problems, we need to be able to describe the problem, we need to understand it from a compassionate perspective. Recognizing every candidate that declares a School of Ed major sees themselves as a future educator in one form or another, and partnering with them, to actualize that vision is the best part of my job.

Rebecca: Well, and we would hope they want to do the same thing for their students. So modeling what we’re hoping to bring into the land of education is certainly a good place to be. We talked before COVID, with the School of Education about some of the really great partnerships you all have both locally and regionally, both as school districts and community organizations. Can you talk a little bit more about some of the outreach you’re continuing to do in those spaces?

Laura: Absolutely. And frankly, we would not be a school of education without partners. Every program housed within the School of Ed requires an applied learning experience. And so even our non-teacher preparation programs in counseling psychology and management programs require some sort of applied experience. And so strong relationships and a strong understanding of the context for our partners is really important to our success and our candidates’ success. So I’ll talk about a few examples since there are many day to day here in the School of Education. For context, in 2020-23, for example, we placed more than 1000 candidates across I believe 246 different settings, kindergarten all the way up through high school. Don’t quote me on the number, but I think I’m close. But we have made a couple of purposeful efforts over the last few years. And in particular around our professional development schools. These are schools where we have an agreement to focus professional development activities for our pre-service teachers, in-service teachers, so folks who are classroom teachers in that district, and align that with our faculty areas of expertise to create what are called that third space for learning, where we were bringing in a range of expertise and perspectives. Here in Oswego County, we have professional development school partnerships with six of our nine local districts. And those partnerships have focused on strengthening support for technology and STEM-oriented initiatives at the junior high and high school level. In another district, it’s included a dedicated focus on early elementary school literacy outcomes and improving the way we’re preparing kids to read and write. Other districts have focused on more systems-level change with strengthening the way that we identify students who are struggling before that becomes a significant impediment to their learning, and organizing teacher and leader responses to ensure that those processes are unbiased, that we’re making decisions that help us put resources around what kids need to thrive. But that’s just a sampling of the types of partnerships that we have with local districts. I think, given the fact that education continues to be a domain where the public dialogue is not always framed as positive, partnerships with our local practitioners and districts, give us opportunities to 1. change that narrative and help people in our communities understand the value that schools can bring to that community. And Rebecca, you mentioned the way that, coming through the pandemic, schools are really regarded as kind of community centers. And I think we’ve seen those types of initiatives be really effective, whether that is including opportunities for families to access medical care, dental care, social services and supports when they’re in district, we have something to offer to that conversation because of the range of our preparation programs here on campus. And so we really tried to engage with our partners in the P-12 sector to ensure that we are operating as a true continuum of care for our communities.

John: During the pandemic, there were some fairly substantial learning losses that disproportionately affected students from low-income households, and low-income school districts. And a study was just released by WICHE in February of 2024, which found that those learning losses are still persisting, which means the students who are teaching in schools are going to face students with a fairly wide variance in their prior preparation. What types of things do you do to help prepare students to address the diversity of student backgrounds in terms of how much they come into the classes with?

Laura: Coming through the pandemic, one of the things we were reminded of was the power of a direct positive relationship between a student and an adult in the building, that can look like a wide range of folks, coaches, teachers, mentors, administrators, volunteers. But that’s something we have continued to embed in our curriculum and helping our candidates understand that day to day, the way that we make students feel is often the thing that will be really critical and helping ensure that they walk through the door the next morning, the next day, or ask for help when they’re having a tough situation. And so empowering our students to respect the dignity of people’s lived experiences, we embed before they move into their clinical experiences in schools, quite a bit of reflection, self-reflection on their own lived experiences, what education has meant for them, the spaces where they have been privileged or perhaps oppressed through educational structures, protocols or policies, and building that capacity of our students to both identify and address bias or embedded bias in the spaces where they work. Getting down into the curricular focus, it is frankly staggering to see how children have been impacted, particularly in the early elementary levels and the older adolescence ages when we think about both academic skills, but socioemotional skills, wellbeing, and I think one of the things that I try to celebrate is the resilience that’s been built into this generation of learners. On the other hand, that comes with a certain amount of exhaustion, anxiety, uncertainty about their future, and so coming back to that element of relationship building, it’s so key. At the curricular level, there is an enormous focus here in New York on the ways that we can do a better job in preparing children to be literate, contributing members of a just society. So right now in New York, there’s a lot of focus on the science of reading. And I want to be really clear to listeners, the science of reading isn’t about a curriculum, it is about embracing the empirical evidence towards a systemic approach to the instruction of reading, writing, and literacy across grades. There’s an enormous amount of energy around this work right now recognizing that we can do better in preparing kids to be literate. And I’m starting to see an equal attention to a focus on math and frankly, STEM preparation. Here in our community in central New York industry has returned with a bang. And there are wonderful opportunities for employment for students with a wide range of educational experiences starting right out of high school for gainful and lifelong employment in these sectors. But what we’ve heard is that math proficiency is often a barrier for those students. And so trying to incorporate elements of curiosity and creativity, bringing science, technology, and math into creative spaces, like art, design, dance, helping students understand that math and science, quite frankly, isn’t just about memorizing equations, or knowing your multiplication tables. But there are a range of application of math, science in our day-to-day lives. When I think about when I was a kid, we had a great lesson on fractals, and we went outside and we found fractals in nature. I remember it to this day, almost like it was yesterday, trying to engage students in their learning, that incorporates their lived experiences, having access to textbooks, readings that reflect their family structures, their linguistic background, the realities of their lives. And so our students ,when they move into those first teaching positions, carrying with them that, I’ll go back to respect for the dignity of all persons, that recognition that kids carry much more with them into a classroom than a backpack, and finding ways that we can empower their learning not just through curriculum, but through curriculum that is delivered at their level, that celebrates individual students growth, that isn’t anchored in some specific outcome, but recognizes individual student’ s growth as meaningful. And I’m really proud to say our data suggests our students do move into their first teaching careers with those skills. And I think the next phase of the conversation starts to focus on how can we, as an educator preparation program, be part of the community in delivering professional development? How can we bring the great work that’s going on in schools to our faculty and have that kind of recursive flow of information, and also ensuring that we are preparing school leaders to create conditions that help us achieve all of these goals. And with our programming here in the School of Education, we’re uniquely positioned because we offer those range of preparation programs and have the luxury of great relationships with partners.

Rebecca: We’ve talked a little bit about learning losses in K-12. But obviously, that has an impact on our college students as well. They also survived the pandemic and are here. What are some of the things that your faculty are doing to help these candidates feel like they have what they need to go into the community having maybe had some experiences of remote learning or challenges with some of these subjects too?

Laura: This is a really important question. And I think it’s one I’ll both answer from the school of education perspective, but also the broader campus perspective, frankly, because we don’t do this work in a vacuum or in a silo. And so I’ll pick up on some of the elements of the last answer, which is making sure that we on campus are framing the opportunity to serve our students as a positive one. We have an opportunity to meet students where they are and that will look different for different students. On the other hand, I think our faculty have been eager to try to crack this code, so to speak, on bridging our lived experiences in K through 12 and transition to college through the framework of the contemporary student experience and those are not parallel for many of us or really even comparable. I have been trying to, as dean of the school, make sure that we are approaching this from a perspective of strength. What students do come to us with us is a resilience that students of prior generations may not have. They come to us with skills and knowledge of technology and how to leverage it in a way that students didn’t in the past. And frankly, it was because they had to learn how to use that technology. Students coming to our campus today have access to more information at their fingertips than any generation of student has ever had in the past. And where we have opportunities is to help students both identify where they may have gaps, whether in their knowledge or experience, put those experiences in front of our candidates, and also help them navigate this world where it’s not always easy to identify what is good information and bad information. Now, let’s drill into some more specific examples there. I think one of the most critical things that we have done in the last few years and again, I’ll give kudos where they’re due to our student orientation groups. We have been embedding ourselves into some of those opening week sessions, where we’ve had the opportunity to talk to our future majors and undeclared students around college- level expectations. And while that might sound silly, I think when students can hear from us, from me, from my faculty colleagues, our stories that many of us are first-gen, were Pell-eligible, have student loans, worked while we were in college, struggled to purchase textbooks, come from different backgrounds, are new to the state or the country. I think that goes a long way as a formative first step in building that trust in the relationship with our candidates. It also gives us the opportunity to begin to plant those seeds around what supports are available to them. Whether that is to help them address their mental and physical health needs, their academic needs through our tutoring center, our office of learning services, the embedded tutoring services, and also come to see us as people that are here to help support them and what their vision for their success looks like. I had a young person come up at the end of our first orientation and said, “I’ve never had someone like you say, you walked in the same path as I have.” And it was really a moment where I understood that coming to the table and being authentic with our students is so critical at this point. The other piece of it, John and Rebecca, is recalibrating the way that we orient our classrooms to continue to give students frameworks for utilizing technology and AI and the wide range of information, also helping them become critical consumers of that information, providing formative feedback to their assignments in real time, flipping our classrooms and allowing students to lead the conversation. I think providing choice as much as possible around what literature students choose to present in classes, for example, have been ways that we have said to students, both overtly and more discreetly, you matter, your story matters and you and my classroom matters. I’ll also share we have been taking a look at the way we offer our curriculum to try to identify, and again as part of a larger campus focus on retention and success for our first-year students, where are the pain points, so to speak, in their degree program, particularly for transfer students, we’ve heard that there isn’t always as seamless of a transition to campus as we may assume. And so really starting to tackle some changes in our course sequence to ensure that our academic programs are set up in a structured sequential way that also gives enough flexibility for students to pursue some of their areas of interest, be student athletes ,be club leaders, or frankly, support their family, which many of our students need to do.

John: Recently, we’ve seen a lot of attacks on education at all levels, with books being banned in the classroom, removed from libraries, and restrictions on the types of topics and the types of history that can be taught in classes. What are some of the things that you do in the School of Education to help prepare students for a world in which they may be facing more challenges from parents and political pressures?

Laura: This is a critically important question and will be critically important action. I hope I could say in the next year, but I have a feeling this will be a long road. Too often I hear colleagues, neighbors, friends say, “Well, Laura, at least we’re in New York, you don’t have to deal with this in the same way.” And while it is true, I am proud to be in a state that has been very overt about people’s lived experience, respecting the civil rights of all persons here in the state. It is also the case that that can change very quickly in an election cycle. And frankly, we have seen that across the country. I’m particularly concerned right now about the way that civil rights discussions have been framed. And there are some cases in litigation right now around bullying initiatives and carving out exclusions or exceptions in those bullying protocols or policies that would allow, for example, trans students to be targeted without recourse. We see that replicated in both sports spaces, but also classroom spaces. I’m deeply troubled that this is a place that we’re going in a country that was frankly built upon public education and access. And we haven’t always gotten that access piece right. Many of our school policies and procedures have been built on an exclusionary clause rather than an inclusionary mission. On the other hand, we’ve made such great gains over the last 10 to 20 years in ensuring that schools are more responsive, supportive, dignifying places. I’m really troubled by this work. For our students, we have a commitment to social justice embedded in the framework of the School of Education. And that is more than transactional or it goes beyond the words social justice. Our curriculum prior to students going into schools is focused on those ways that schools have been exclusive spaces, have not always dignified the realities of the people who walk through the doors. And so for our students, what we tried to do is help them understand the threats or attacks on people’s civil rights or their histories is not new. On the other hand, it’s taken a very different tone in the way that it’s being implemented. So 1., it’s giving them the tools in knowledge and understanding of history to understand schools don’t have to be exclusive places, schools can be responsive, welcoming, encouraging spaces for all students from all backgrounds. It’s also about helping students understand that I want to be a teacher, I don’t want to be a politician is not a reality in which they will live as an educator. We try to empower them without encouraging them to engage in any particular behavior, to stay attuned to the realities of how legislative efforts, school board votes, and other sorts of community oriented book bans and dialogues might impact their ability to teach a particular lesson, utilize a particular academic resource. So you may have seen coming out of Florida, among other things in the last few weeks, a school district teacher had thought that it was prudent to send home a permission slip to alert the parents, that their children were going to be exposed to a black author. It wasn’t about the content of the book, it was simply the fact that they were going to be reading a book from an African- American author. I can’t think of a better example to highlight the importance that an apolitical stance is not one that classroom teachers can take, that school leaders can take. And that’s not about voting for a particular person or a particular party. But it is standing up to ensure as educational experts who have preparation, expertise, and insights that the community may not, to share them and be vocal about the ways that diverse learning materials, accurate historical representations of the world are critical towards ensuring that we do not replicate them. And so I am both incredibly disheartened at the turn that this discourse has taken. I’m also incredibly optimistic when I look at how young people, how educators, how experts have shown up and linked arms to say: “This is not right. We are not going to correct the wrongs of our history by limiting access to that history or by building smaller tables with fewer voices.” And so I tried to stay in that headspace as much as possible.

Rebecca: Definitely some good reminders and things for all of us to be thinking about in our role as educators. So we always ramp up by asking what’s next?

Laura: I love that question, because I could probably read you a laundry list of the things that we’re thinking about in our School of Education. Right now, here in New York, there’s a lot of robust conversation around, what does a high-quality teacher look like? What are they ready to do in their classrooms? And there’s a lot of engagement there. And again, this relates to helping the public understand not just what we do day to day or what the outcomes are, but the opportunity space towards preparing children for lifetimes of success. Here in the School of Education, we’ve got a range of new programs that we’re lifting in the fall of 2024, including our new master’s degree in behavioral health and wellness. And frankly, I think we have a range of new programs. As we talked about industry thriving here in central New York. There’s also a lot of energy in the school of education around our career and technical educator preparation programs, and of course, our technology education programs, some great investments in our lab spaces, looking at opportunities to do more in partnership in and with local districts to ensure, as we were talking about kids across Oswego County, have great opportunities to engage with science and technology and math in ways that bring them out of the classroom and into the world and creative spaces. So I’m really excited to see what the year ahead is going to look like for us.

Rebecca: Well, thank you so much for joining us, Dean Spenceley and for our wonderful space.

John: …and we’ll be talking to you much more in the future.

Laura: I look forward to the opportunity. Thank you both.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

336. The Multi-Disciplinary Instructional Designer

Instructional design is a discipline that people often discover and pursue as a second career. In this episode, Chris Gamrat and Megan Kohler are the editors of The Multi-Disciplinary Instructional Designer: Integrating Specialized Skills into Design Toolkits, which discusses how prior backgrounds and careers can contribute to the process of course design.

Show Notes

Transcript

John: Instructional design is a discipline that people often discover and pursue as a second career. In this episode, we discuss how prior backgrounds and careers can contribute to the process of course design.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are Megan Kohler and Chris Gamrat. Megan is an Assistant Teaching Professor and Learning Designer in the John A. Dutton e-Education Institute at Penn State. She is the recipient of the Marion G. Mitchell Award for Innovative Teaching and is conducting research, funded by a Schreyer Institute Scholarship, on supporting neurodivergent learners in higher education. Chris is an Assistant Teaching Professor in the College of Information Sciences and Technology at Penn State. Chris and Megan are co-editors of The Multi-Disciplinary Instructional Designer: Integrating Specialized Skills into Design Toolkits.
Welcome, Megan and Chris.

Megan: Thank you. We’re happy to be here.

Chris: Thank you.

Rebecca: Today’s teas are:… Chris, are you drinking tea today?

Chris: I’m having coffee right now. But tea will be coming later.

Rebecca: Alright, good.

Chris: …still waking up.

Rebecca: Coffee is one of our most popular tea flavors. How about you Megan?

Megan: I am drinking a chai tea this morning in my lovely mug. [LAUGHTER]

Rebecca: I like it. It says “Hello Gorgeous” on her mug. [LAUGHTER] John, would you like to talk about your blasphemous tea this morning? [LAUGHTER]

John: I am drinking a hazelnut coffee tea today {HORRIFIED SOUND]. Coffee does seem to be a popular tea. But what happened was, we’re in a new recording room. And I came here early to set some things up. And I realized they did not have time to get back to my office to make some tea. And so I stopped at a nearby cafe. And it turned out they did not have tea there. I didn’t have any other alternatives. They didn’t even have iced tea that I could see.

Rebecca: John has only not had tea two times… once was water. And once is today

John: …and the other time was a day when we lost [LAUGHTER] our old recording studio and I just didn’t have time to get the tea made after my class.

Rebecca: Today I have a Scottish afternoon tea.

John: That’s better.

Rebecca: Yeah, it’s really smooth. I really liked this particular kind. Brodie’s is the brand.

John: We’ve invited you here today to discuss The Multidisciplinary Instructional Designer. Before we discuss this, though, it might be helpful to just talk about the various roles that instructional designers play in supporting instruction. And it seems like that role varies quite a bit from campus to campus, and even from school to school on campuses. So could you talk a little bit about that to help set the stage for the rest of our discussion.

Chris: I was an Instructional Designer for eight and a half years here. When I met with new faculty, I would explain that I serve kind of two functions. And the first is that I was a little bit like Q from the James Bond franchise, where I was in the background, doing research and developing new tools and things that they could use out in the field. And all the faculty tended to really like that analogy, because then that made them like a double 0 agent. They’re like, “Oh, yeah, that sounds good.” And then the second is concierge. So they will be able to come in and say, “I’m really running into this issue. What do you suggest?” Or “How am I gonna get around this, given the tool sets that we have available.” And so using the depth of knowledge I have, and the exposure I have from my own teaching and from working with many other faculty, I’d be able to make recommendations for them. So those are the ways that I would explain to our faculty

Megan: My explanation is not nearly as cool as a double 0 seven agent. [LAUGHTER] My explanation is that I think a bit more functional, from the perspective of instructional designers when we’re working on projects tend to be the glue that holds everything together. And we also end up being the conduit or the avenue by which a lot of information gets communicated. So we really help the faculty members think through how they want to present this content to the students, what’s the best way to do that, what types of media are best going to support and reinforce that instruction, and also what’s going to be the best options for students in terms of how they consume and retain that information. But there’s a lot of other components that come into this mix as well. So there’s graphic designers, there’s videographers, there’s so many different elements that go into this… project management too, is another really big one that a lot of people don’t really understand is a really critical skill for an instructional designer to have. And so we have to have all of this knowledge, even programming and basic coding, communicating with programmers in order to help them understand what a specific vision is. So we need to know enough about all of these different areas in order to be able to communicate effectively. And also, our primary focus ends up being on the pedagogical pieces. So we really wear a lot of different hats, and have a lot of responsibilities in the course design process.

Rebecca: I first heard about your book when I was at EDUCAUSE and Chris and I connected there. Can you tell us a little bit about how this book came about? I know that I was really interested in it the second I saw it.

Chris: That’s a Megan story for sure. [LAUGHTER]

Megan: Yeah, it actually came about somewhat organically. My background is in theater. I was a professional actor for many, many years, like 12 or 15 years, before transitioning over into the field of instructional technology. And Chris was participating on one of our professional development communities for our instructional designers here at Penn State. And one of the topics that came up was how do we help learning designers improve their presentation skills? And Chris was like, “I know exactly who I’m going to ping [LAUGHTER] to see if they can help with that.” And so he reached out to me, and he said, “Hey, Megan, can you come and give a presentation on how to help instructional designers refine and upskill their presentation skills.” And I was like, “Of course.” And so I went, I gave the session, and it was really well received. And I think Chris and I both walked away from that, with this little idea in the back of our minds that there might be something more to this, but we didn’t really pursue it. And then two-ish years later, Chris pinged me. And he was like, “Hey, I think this is a book.” And I was like, “I love it. Let’s do it.” So then we just sat down and pulled together ideas for the book. And here we are. This is about, what, a year, year and a half work. But now we have our book in hand, and it’s very exciting.

John: In your book, you note that instructional designers bring a wide variety of backgrounds into the work. And a major theme throughout your book is how instructional design can benefit from the specialized knowledge that each instructional designer brings from their academic training or from prior work experience? Could you share some examples of that with our listeners?

Chris: Yeah, I can talk about some of my experience. In my chapter, we talked about concepts around crisis management. So prior to working in the College of Information Sciences,and Technology here, I worked for NASA for about five and a half years. I was on a grant for them, and we were doing professional development for teachers across the country. So we were doing workshops for probably 10s of 1000s of teachers every year, maybe even more than that. So that entered in like a lot of room for failure, just things don’t work out. And the thing that I thought was really interesting, that permeated even into the culture of NASA education was that attitude failures, not an option, there always has to be: there’s a plan and a back-up plan and plan all the way up out through Z. That, really, we need to have a way of making things resilient. And so I had like that nugget of an idea from my work with it. And then it came to the college of IST, and we have a program called security and risk analysis. And inside of that, we really do spend a lot of time focused on teaching in building out resilience for any number of organizations. A lot of our students end up working for the federal government and other institutions that cannot do their job. And so I started to acquire more and more of that language on this concept, to really be able to describe the things that we were doing back when I was working on that project. And for the entire time that I was on my learning design team here at Penn State, we realized that we were building in this resilience without even necessarily naming it. So my colleagues and I spent our chapter really more formally defining, here are some of the processes that you can take advantage of. And there are really well-defined techniques that go into that that are being used by FEMA, the CIA, any number of huge and really critical parts of our government. So that was something that I realized, like, “Wow, this could be really powerful.” And when I started to flush out that chapter, I said to Megan, I think people are going to really have a good time reading this, and they’re going to get stuff out of it. So I really, even just in the writing process… and normally, writing is kind of like the hard part…that was fun.

Rebecca: …always nice when that lands as fun. [LAUGHTER]

Megan: Absolutely. Yeah. So I’ll just tag on to what Chris said a little bit by sharing some more pointed examples from the book itself. When we put out a call, we really were looking for people who had unique perspectives and backgrounds that we wanted to capture as part of this overarching story of the uniqueness, but also the variety that goes into the field of instructional design. And it’s especially relevant right now, because there are so many people that are transitioning out of different positions, a lot of K through 12 teachers, actually, right now are transitioning and looking at the field of instructional design. But really, for anybody who’s interested in this, you might think, well, this is a completely different shift in the skill set that I have. How on earth would I even make this transition? And the reality is that so much of what we do as instructional designers can draw on other fields. And one of my favorite examples that I always love to pull from, my friend, Paul, saw that we put out this call and he was like, “Hey, would you be interested in hearing my perspective on a military background?” And I was like “Submit a proposal.” He did. And then we reviewed it and what he had to say blew us away. His chapter is called “Out of the frying pan into the fire, the unintended and amazing consequences of risk taking in the practice of instructional design.” And I think that that’s something that is so wonderful to keep in mind, because instructional design becomes all about our processes and procedures, we have all of these things in place to ensure success. So when you think about the notion of risk taking, that doesn’t always seem like it’s something that pairs well with instructional design. But in his chapter, he makes a phenomenal case for why we need to be willing to take those risks as instructional designers and ways that we can go about doing that. In addition to what Paul has written, we’ve got chapters about how choreography from ballet can contribute to our design thinking processes. We’ve got stories about feminism, and how they can impact what we do as instructional designers. So it really is this piece of work that has such varied and amazing perspectives. And hopefully, people when they read this, they won’t just view it as, like, here’s a new set of skills that I can apply, because it’s definitely that but it’s so much more; it’s about how we can feel more impassioned about what we do as instructional designers, and how we can help share those passions from our prior fields into the work that we do today and then share that back with the faculty members in order to help engage them and inspire them as they go about these design processes as well.

Rebecca: I really love hearing you guys talk about the interdisciplinary nature, because as an interaction designer, or someone who’s in the design field as a whole, I see the design field as just being a very interdisciplinary place that’s borrowed from many different places over time to kind of make its own set of rules and principles that we follow in the big bucket of design. So it’s nice to hear how all these different disciplines and fields continue to make the discipline of design evolve. Can you talk a little bit about who you see the audience of this book being?

Megan: Sure, I think the reality is that this book can appeal to anyone in the instructional design field, as well as people who are even just curious or interested about transitioning into it. Because even if you’re a seasoned instructional designer, there’s perspectives in this book that you’re not going to have, that can help enrich your own toolkit. So if somebody doesn’t have a military background, they can read Paul’s chapter and learn about different skills, risk taking, resilience, many, many others. I do not have any kind of a background in feminism, but yet, when I read Jackie’s chapter, I learned a lot of different things that I will then go forth and apply. So I think it can really help seasoned designers build up their skills from incorporating new perspectives, but also somebody who’s just kind of curious, like I kind of mentioned before, people are transitioning fields post pandemic, and somebody is questioning, is this the right field for me? How would I even go about fitting into this? Or how would I go about making that transition? This kind of a book is a great read for them, because hopefully, they’ll see how these other different skill sets could be leveraged, and then maybe there’ll be inspired. And they’ll think about how their own skill sets could be leveraged as they move or transition into the field of instructional designer, instructional technology.

Chris: First off, I think, Megan captured it really well. I do think it’s very much a book for people who are just professionally curious, I think there’s an appetite for wanting to know a little bit to that. One of the things I describe as valuable a skill as a designer is being like a professional novice, when talking with a subject matter expert, knowing the kinds of questions to ask, to tease out being able to explain something well and effectively, and I think these chapters get to that, because for basically everyone who contributed a chapter to this, that was a different life, an entirely different way of thinking. And they’re able to provide it in a really consumable way for this audience. So I think anybody who is interested in that would greatly benefit from these chapters, because they’re designed to be picked up and run with.

John: Might a case also be made that this could be useful for administrators who might not always understand the role of instructional designers, especially if they’re looking at ways of improving instruction? And might it also be useful for faculty who do not always have instructional design support on their campus to consider various ways in which they can bring other knowledge and skills into the ways in which they design courses.

Megan: Yes, 100%. That’s a great perspective. Thank you.

Chris: Yeah, actually, one of my co-authors is a faculty member that I’ve worked with quite closely over the years. And that was something that he made a comment on, it was just like, “I didn’t realize that this skill set is impacting how I’m teaching.” And it’s just like that, revealing that what’s maybe obvious, that it’s actually already embedded in your practices. So I think ,absolutely, many subject matter experts would benefit from this for sure.

Rebecca: Both of you authored chapters or co-authored chapters in the book. And I’m hoping we can dig into a little bit of the content of some of those chapters so that folks can really see the benefit of the content. So Chris, you already hinted that your chapter talks about your time at NASA, and you kind of develop a resilience plan, a process that people can follow. Can you talk a little bit about what you mean by resilience and crisis management? And what that process might look like for folks?

Chris: Yeah. So when I’m teaching, I think about designing my courses in a way that fails gracefully. So day one, I think about when we have our very first class… okay, well, obviously, we’re going to talk about the syllabus, but also at the same time, literally everyone on campus, all 50 some thousand students and faculty are logging in to our learning management system all at the same time. So it becomes super slow. So how can I avoid, “Oh, we’re in class, I wanted to talk about my syllabus, but it can’t, because things not loading?” Well, I can be able to anticipate that because for sure it’s gonna happen. So I print it out, and I have a copy with me so I at least have that as a backup. And there are other things that I can think about where if the resources are down, if something happens in the class, how do we pivot? Many years ago, when I was still working on that professional development committee, the one that we asked Megan to come in, we did a session with the idea around being able to pivot gracefully, with that concept of like, all the snow days. One had just happened, so we’re thinking like, okay, let’s plan ahead. And we did that session, I think in November of 2019, we were not thinking about what else we might have to pivot around. So it really became a subject that a lot of people were suddenly way more interested. And so when we start to inject more of a methodical approach to that, you start to brainstorm, “okay, what are possible disruptions that might happen?” Well, students could get sick, that’s definitely going to happen, I could get sick, how do I deal with that? so on and so forth, and you put out all those ideas, and then you attach a weight to them. And the weight for that is calculated by likelihood of it happening, and how much it might provide an impact to the class. So if one student is out, maybe no big deal, if a lot of students start to get sick, well, then you have to really adjust. Or if I get sick, that would be a big impact. Because I might not necessarily have like, something else to do for a given day. So those are things that you would outline and identify, Okay, these are the top three that are going to be the biggest impact. Those are the ones that we build into our design. So that way you can adjust around those. That was, I think, a really valuable takeaway from this. And to prepare for the chapter, I was reading up on how actually standardized that description is for likelihood of risk. So basically, there is documentation that talks you through how you can attach a weight of like, well, that’s like 80% versus 60, etc. So there’s really a lot of detail that you can dive into, and be able to, again, provide a rubric for likelihood of risk. So when I say rubric, that’s my jam, so that has already piqued my interest as well. So those are a couple of things that I really took out of preparing this chapter and getting those prepared.

John: Megan, you already mentioned that you were an actor before. Could you talk about how that’s informed your work as an instructional designer? You have a chapter on that in the book?

Megan: Yeah, definitely. One of the things that I think people don’t always realize is how communication is a critical piece of what we do as an actor. People are probably thinking, “Well, you go in and you read a script, how is that freeform communication?” But the reality is that all of the communication that occurs in order to get the production up and running is very extensive. And I think one of the greatest examples that I can pull from in order to help people understand how critical communication is in a theatrical setting is in the context of stage fighting. So you figure you get swords on stage [LAUGHTER], and people are learning how to choreograph. Well, I mean, someone will come in and someone will choreograph a fight scene for a set of actors, and then they will have to enact it. But people have to feel comfortable speaking up and saying, I’m not comfortable with how this is working, could we try something different? And it is a really important skill to be able to communicate and to advocate for yourself as an actor, and something that I feel like a lot of instructional designers don’t always fully understand how to build as a skill. I think a lot of times a lot of instructional designers can sort of default to the “Oh, I have this blueprint, and then I’m just going to ask the faculty member to fill out this blueprint, and I’ll explain to them what this blueprint is about.” But the reality is, we need to be able to provide things that are out of context in order to help make connections between different things for faculty members. So I have a great example. In addition to working at Penn State I also have a consulting firm, I do consulting work on the side. And I was just working with some faculty members the other day, we’re designing a micro learning course. And they were having a really difficult time stepping away from the notion of, “Well, we’re just going to provide them with some bullet points, and then we’ll talk to those bullet points in the synchronous sessions that are going to accompany these micro learning experiences.” I was like, “Okay, but let’s think about the breadth of information that you’re covering, you’ve got seven different modules, and they’re full of bullet points. How are you going to cover all of those bullet points in one synchronous session?” And they were just really struggling with that concept of stepping away from the expert perspective and into that perspective of a novice. So how are they gonna help draw those connections or expand upon that information, so that it’s not just bullet points that there’s actual content there? And I gave them an example of like throwing a dinner party, I’m like, “Okay, well, let’s say we’re throwing a dinner party, I’m gonna send you to the grocery store, and I need you to pick up items for dinner and dessert and a nice drink to go along with it.” And I said, “What are you going to pick up?” And they’’re like, “We don’t know.” “That’s exactly where your learners are right now. You need to be able to identify what all of the ingredients are, and explain how those things are going to come together in order to form the dish that you’re going to serve at the dinner party.” And then they were like, “Oh, now we get it.” And so that communication is just such a critical element of what we do. And if you’re not communicating, well, your project is going to fail. They say there’s statistics that show that the communication is the fail point of every project and 80% of every project is communication, and the other 20% is the actual work. So it’s really a critical component of what we do. And I think the skills that we learn as actors can help build those skill sets for instructional designers. So that’s what the chapter that I wrote with Penny Ralston-Berg is all about.

Rebecca: It’s really interesting, and this exact moment in time, Megan, hearing you talk about this actor perspective, because our Graduate Studies Division is having the actors of the London stage come in and do a workshop for our graduate students, a professional development workshop on communication. [LAUGHTER] And really, everything you just outlined is exactly the kinds of things that our graduate students are hoping to dig into as well. But it really comes from this disciplinary background and providing some new tools to our students.

Megan: Yeah, I’m not sure if you’re familiar with this, but Alan Alda, he’s very famous from being an actor on MASH, he has a communication program for scientists that’s based in theatrical principles. And so he goes in, he has this training session that he runs with scientists at different institutions and organizations all over the world, but it helps them understand how to become better communicators. So yeah, it’s just definitely something that people can leverage. You can always become a better communicator.[LAUGHTER]

Rebecca: Definitely. [LAUGHTER]

John: And one of the things you also just said was that one of the roles of an instructional designer is to remind faculty of what it’s like to look at their content from a perspective of a new learner. Does the fact that the instructional designers are not generally in the same discipline as the instructors provide that sort of assistance that faculty might lose? Because once you become an expert in some discipline, it’s really easy to lose perspective on what novices know, and how quickly they can absorb material.

Megan: Yeah, absolutely. That’s 100% true. One of the things that I always tell faculty, when I meet with them, is “I get to be your sample student.” And that really is a gift to the faculty member when we’re working with them, because we’re going to be looking for things in which there are gaps, or there are overlaps. And that’s what we do as instructional designers, or part of what we do as instructional designers. But we also have that ability to communicate that back to the faculty member, whereas their students, they’re not going to do that. They’re going to take the information as it comes in, and they’re going to try and work with it as best they can. But having that sounding board or that ability to get that feedback from an instructional designer, in terms of “I don’t fully understand what it is that you’re trying to communicate here. Can you explain this to me a little more deeply?” Or “Can you expand upon this?” or “Let’s add some details in,” or “let’s add a graphic in that’s going to help convey this concept.” It’s absolutely a piece of the puzzle in terms of instructional design.

Chris: That just reinforces what I said earlier, which is I very much believe an instructional designer is an expert novice, among other things. [LAUGHTER]

Rebecca: It seems like to be able to share that information back to faculty, there has to be a level of trust between the faculty member and the instructional designer. Can you talk a little bit about that?

Chris: I agree that there is a huge amount of relationship building in design work. I’ve worked with different faculty where they were skeptical of me, skeptical of getting help, didn’t necessarily need to see that there was value, and being able to explain the process, how things work. how I can provide those needs, in the different ways that we talked about, can really push it over the edge to go from me showing up and checking in with them weekly or whatever is a burden to I’m looking forward to talking with Chris. And when they realized that that help can be whatever they need it to be, and that it can take many different shapes, that really changes the tone or the conversation. There are some faculty where I would meet with them for a few minutes to talk about the course and progress that they’re making, they would ask me about what’s going on. At the time, we were switching from our old LMS to our current one, and they would ask, like, “Oh, what do you know about this or that?” and I’d fill them in on the kind of like, university gossip almost of like, “yeah, transitions going on at this pace. And here’s what you need to know.” And that was valuable to them. So they were responsive to it, and that meant that went from having one kind of okay development process to three in the span of about four months. They were receptive to that by the end, like they wanted to work with me. So I definitely think there’s huge amounts of benefit. And I think they had been exposed to what we have in our book of like, “Here’s all these different things that we can bring to the party,” they would have warmed up a lot faster.

Megan: Trust is a piece that Penny and I also talk about in our book chapter on theater. And it’s really interesting, because as an actor, a lot of times you’ll be hired to be part of a show. And you’ll come in and you’ve never met any of these people before. But yet, suddenly, you have to work with them, and you have to be efficient, because you have limited times, I mean, sometimes you will have maybe a few weeks, sometimes you’re fortunate enough that you have like a two-month rehearsal time period, but you need to figure out how to learn to trust one another and work with one another very quickly. And so anybody who’s interested in learning some more skills in terms of how you could leverage that from a theater perspective, I definitely encourage you to get a copy of the book and check it out.

John: In each of the chapters, you have the authors introduce themselves and their background. Could you talk a little bit about why you chose that approach?

Chris: Yeah. So when we first started meeting, we realized that there was tremendous power in getting to know the backgrounds of the contributing authors, not just the topic, or the subject matter of this is their background, here’s why journalism can help you, here’s why theater can help you, etc. But really getting to know them and understanding their experiences was very powerful. We asked each of our contributing authors to contribute somewhere in the neighborhood of a page or so introduction that is more of a narrative or story about here’s how I got to where I am, and how I use these types of tools. And I think Megan and I probably talked about this after the fact, which is just that I feel like even though most of these authors we’ve never met in person, I feel like I’m a lot closer to them, [LAUGHTER] just having read those chapters. So I think that that’s super powerful. And one thing I’m really proud about with this book.

Megan: Yeah, and I want to tag on to what Chris said, because another reason why we wanted to capture the stories of these people’s journeys, was because we wanted to also remind people that instructional design isn’t just about the skill sets and the tools and the technologies, that we are human beings, and that we all have something valuable that we bring to the table. We all have journeys that we have walked through, we all have bumps and bruises as well as highlights and glimmering moments. And we wanted to try and capture that in this book as well, so that when someone was picking up this book, and they were reading through it, they felt connected to the people who were sharing this information so that it wasn’t just a series of strategies that you can include in your toolbox. But it was more like you were having a conversation with a mentor or a friend who was giving you advice in terms of how you could build your skill set based on the knowledge that they have to share with you.

Rebecca: I think one of the things that’s really interesting about the narrative approach, or really the diverse group of instructional designers that are represented in your book and the disciplines that they come from, is that it’s not like we wake up necessarily thinking, “Hey, I want to be an instructional designer when I grow up.” [LAUGHTER] It’s not necessarily one of those fields that are obvious, especially when you’re making those first choices for your college education, for example, and maybe not even later on. A lot of folks change fields or end up here at a later time.

Megan: Yeah, that’s absolutely true. And I know that that was definitely the case for me. [LAUGHTER] Life is full of interesting twists and turns, isn’t it?

Rebecca: Definitely. So we always wrap up by asking: “What’s next?”

Chris: That is my absolute favorite question. [LAUGHTER] In large part, I really do like to have a what’s next. When I was working with NASA, we would go to school districts and do big workshops with teachers, and they would get so excited about the thing. And they come up with like, “Oh, what can we do after this?” And for a while, in the early days, the answer was, “Well, maybe we can come back in a year.” And to put a wet blanket like that on the passion for learning, for being able to explore and do new things, is really upsetting. And so I really took that to heart. I always like to have something for students, for colleagues that I’m working with, like, “What is that next thing?” …whether it’s a new project or a different angle for research or whatever or another class that they could take. So I love the question. Megan and I have talked about a second edition, possibly. Meghan, I don’t know, if you want to throw out some other things that you’ve been thinking about.

Megan: Sure. From the book perspective, definitely, we would love to do another edition and possibly even a third edition, because there’s just so many different perspectives. As we’ve been talking about this book, one thing that we realized that was missing from this, there’s many different professions and fields that are missing from this, but one that really sort of surprised us as we were having conversations with people, and quite frankly, it shouldn’t have. But we were having a conversation with a stay-at-home mom, who was interested in instructional technology. And she’s like, “When I think about this, all I do is manage people all day long.” She’s like, “That’s what I do, I manage people.” And we were like, “Yes, you do. [LAUGHTER] “You 100 percent do.” And that’s a perspective that I would love to circle back around and capture in a new edition. And there’s just so many other people who have interesting and varied backgrounds that have a story to tell and have different skills that they can share, and about how those skills can help us be better designers. So from that perspective, hopefully, the book will sell really well. And the publishers will come back and be like, “Yes, another edition. Let’s do it.” For me professionally, I’m doing a lot of work with neurodiversity in higher education, and how we can support neurodivergent learners in higher education contexts. I have a couple of workshops coming up with that, as well as some other speaking events. So we’ll see how that pans out. [LAUGHTER]

Rebecca: It’s always nice to have adventures on the horizon, right?

Megan: Oh, absolutely.

John: Well, thank you for joining us. I enjoyed reading through much of your book. I haven’t yet had a chance to finish it. But it was really interesting. And I’m looking forward to reading the rest.

Rebecca: Yeah, it was great to hear your stories and to share your work with everyone. Thank you so much.

Megan: Yeah, thank you. And maybe there’s a chapter in the next edition about podcasting and how you can leverage those skills as an instructional designer,

John: Well, we began this for professional development purposes. And that is a large part of the role of instructional designers.

Megan: Absolutely. Well, thank you so much. We really had a wonderful time talking with you today.

Chris: Thank you for having us.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

334. Journey Toward UDL

Most faculty begin their teaching careers with little preparation in effective teaching practices. In this episode, Jeanne Anderson joins us to share her journey toward inclusive teaching practices and universal design for learning. Jeanne is a faculty development coordinator at Waubonsee Community College, and an adjunct faculty member in the English departments at Elgin and Waubonsee Community Colleges, and the College of DuPage. She teaches a mix of online, face-to-face, and hybrid writing courses.

Show Notes

  • Tea Tree
  • ACUE
  • 4 Connections Curriculum
  • Transparency in Learning and Teaching (TILTHigherEd)
  • Behling, K. T., & Tobin, T. J. (2018). Reach everyone, teach everyone: Universal design for learning in higher education. West Virginia University Press.
  • Tobin, Tom (2020). Pedagogies of Care: UDL. Tea for Teaching podcast. Episode 138. June 3.
  • Angelo, T. A., & Cross, K. P. (2012). Classroom assessment techniques. Jossey Bass Wiley.
  • Darby, F., & Lang, J. M. (2019). Small teaching online: Applying learning science in online classes. John Wiley & Sons.

Transcript

John: Most faculty begin their teaching careers with little preparation in effective teaching practices. In this episode, one faculty member shares her journey toward inclusive teaching practices and universal design for learning.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Jeanne Anderson. Jeanne is a faculty development coordinator at Waubonsee Community College, and an adjunct faculty member in the English departments at Elgin and Waubonsee Community Colleges, and the College of DuPage. She teaches a mix of online, face-to-face, and hybrid writing courses. Welcome, Jeanne.

Jeanne: Thank you, John.

Rebecca: Today’s teas are:… Jeanne, are you drinking tea today?

Jeanne: I am. I was out and about today, and I stopped at the Tea Tree in downtown Batavia and told them I needed something tasty that would give me some endurance, because I’m a little tired today. I just got over COVID. And so they actually made me a cup of endurance tea.

Rebecca: Oh, look at that.

John: Excellent.

Rebecca: Who knew? [LAUGHTER]

Jeanne: It’s a mix of herbs that have been traditionally used for increasing stamina.

Rebecca: Well, I hope it works.

John: I do too.

John: And I have English breakfast tea today.

Rebecca: Oh, it must be a theme. I have Scottish afternoon tea. We’re all looking for a little energy. [LAUGHTER]

John: …which is a little more appropriate because we are recording in the afternoon, at least here on the East Coast. We met at the POD conference back in November and we sat at the same table at one of the sessions. And we talked a little bit about your practices. And we’ve invited you here to talk about how you’ve integrated inclusive teaching practices, including UDL into your writing classes. Could you tell us a little bit first about what prompted you to adopt a UDL approach in your classes?

Jeanne: Well, John, I have four kids between the ages of 14 and 21. And three of them are neurodiverse. And my 21-year old has autism. My 15 year old has dyslexia and my youngest has ADHD. I started teaching in 2000. I became a mom in 2003. And autism was a word that was introduced in my life in 2005, when my son was 21 months old. So throughout the time that I was starting to teach, and also then throughout the time that I was raising my son, there was a constant theme of having to meet him where he was at, because most normal kids, babies, you would put them in a stroller and go to the mall, and they’d sleep, where my son would cry and scream. But if I brought him home, and he went in his little swing, he was quiet and he was content and he was happy. And so there were just a lot of things that I had to give up at that time to be able to meet his needs. So I had an interview for an adjunct position while I was still in graduate school, at a college in Chicago on a Tuesday afternoon, right after Labor Day. And by mid-afternoon, they were walking me to HR, and I was being told that I would have a class very soon. And then the man I interviewed with, Mr. Haynes, he turned out to be one of my mentors, he came back and he said, “Oh, can you sub tonight? You get paid $150, all you have to do is pass out the syllabus and turn on a video.” And I was like, I could watch a movie for $150.” So I go down and I do my subbing thing. And he knocks on the door, and he hands me a set of books. And he says, “Okay, your class is Monday, Wednesday (it’s Tuesday night I won’t be home till 10). your class is monday, wednesday at eight o’clock in the morning, and you’re teaching Comm 101. And I’m thinking “this isn’t even my discipline.” And so I kind of got thrust in this classroom, not knowing how to teach, as many of us are, and we rely on the good or bad practices of our previous instructors in college. Really, one of the first principles that I talk about, one of the first things that I have to be intentional about, is meeting students where they’re at. And I do that because, at the time, I didn’t know what else to do with them. And so I would just gauge who they were and what their needs were and I would try to meet those needs. And so that’s really the first seven years of my teaching career, I kind of relied on that principle of just doing what my other teachers used to do, and meeting my students where they were at.

Rebecca: Definitely a good way to get involved in inclusive teaching and a good framework to dig into a lot of models that are out there.

Jeanne: Definitely, and this college, they didn’t have any remediation. And they really took a lot of students from Chicago Public Schools who truly needed the remediation. And so as a faculty member in these classes, I really had to figure out what their needs were. I couldn’t fix them, but I could give them the best college experience that I could in the courses that I was teaching. And so that’s really what I sought to do. It was also a very diverse group of students. Most of my students were either Hispanic or black. And so, again, another reason to just meet your students where you’re at, get to know them and make them feel comfortable. They’re in a setting where they feel like they don’t belong. And so years before I knew about imposter syndrome, I’m in a classroom having a severe case of impostor syndrome with a group of students who also have impostor syndrome, and that’s really been the bedrock of how I started working with students in the classroom, is making them feel comfortable. Some of the professional development that I’ve done has really informed my teaching practices in a new way over the last few years. The first third of my career was me just kind of figuring out how to teach and also having a child with autism, and using some of the skills that I picked up by raising him, applying those things to the classroom. Whether it’s slowing down my speech and being more intentional and direct in the things I say, that was one thing that I did with him. The second third of my career, we adopted two children, and so I kind of took a backseat. I was still teaching an insane amount of classes, but I wasn’t really making much movement in professional development. And that’s where I was working on getting diagnoses for dyslexia and ADHD, and trying to figure out in their education, like how does trauma inform their education? How are learning disabilities informing their education? How does the fact that they grew up in a Spanish speaking home for the first four to six years impact their education? These are all things that I can think about when I’m talking to my students, because as a writing instructor, especially since my first assignment in English 101 is a literacy narrative, they’re very open about if they grew up in the Spanish speaking home, or if they had a learning disability and they hated school, and the fact that they know that I have this background kind of fosters that engagement and connection. So the last five years, I’ve really focused more on professional development. And I took the ACUE courses. And then I became a Faculty Development Coordinator, and at College to DuPage, they offered a paid course for adjuncts. The curriculum was 4 Connections, that’s what the course was called. 4 Connections comes out of Odessa College in Texas. And the 4 connections are checking in with students regularly, practicing praxis (which means maintaining rigor, but also having flexibility), one-on-one check-ins, and learning students’ names. And so as far as inclusive teaching practices are concerned, again, these are all things that when I started teaching, they were almost frowned upon. You don’t want to engage with your students too much. You’re there to lecture, they’re there to learn, and there’s no late assignments, and if you plagiarize, then you’re out of here. And these were all habits of faculty back in the early 2000s that I grew up under, but that didn’t work for me. And so I looked at these 4 connections, and all of a sudden, it was very validating, because it was like, “Well, I’ve kind of been doing this all along, checking in regularly, that’s something that I do with students, the one-on-one meetings, that’s the one that always kind of enrages faculty, especially adjuncts because of how thinly we’re spread. But if you can get past the I don’t have to meet with every student one on one, I started that process by saying, Okay, we’re post pandemic, I’m comfortable with Zoom… I went from “Why are you taking an online class, if you want to talk to me, you should take an in-person class,” that was kind of the mentality of the early 2000s and mid 2010s. I went from that to, “Hey, it sounds like you could really use a zoom call. Let’s get together. Let’s have a one on one, let’s talk” and really just students getting to know me and me getting to know them a little bit really helped get them on track. They needed that engagement to get on track. The practicing praxis, I used to be told in my early years, “Oh, you’re too flexible. If it’s past the deadline, you shouldn’t take it, it’s a zero.” And in the culture that I was working in, nobody was turning things in on time. There were so many obstacles to the students I had in the beginning. Being a writing instructor, students definitely walk into your classroom not wanting to be there, and believing that you are judging them from the get go. And you kind of are. And so it’s always been my intention to make students feel comfortable so that I can get the best writing from them as well.

Rebecca: What are some of the strategies that you use to make students feel comfortable?

Jeanne: I was thinking about my teaching style, and how I would talk about it. I came up with four principles that I really follow: being intentional about meeting students where they’re at, so getting to know your students and meeting them where they’re at while also maintaining rigor and meeting those learning outcomes on the syllabus, because those are two very important components of getting your students through your college courses. I’m also very intentional about engagement. So when I start a class, whether it’s online or face to face, I want my students to know that they’re making friends in this class, and that they and their peers and myself were all part of a learning community, and I’m learning from them. I don’t necessarily call myself an expert. I have so much to learn. And a lot of things that I learned, I learned from my students. I give them an assignment, and they give it back to me, and then I learn about what are the good aspects of that assignment, and what parts of that assignment really need to go. My students teach me that. I can’t learn that on my own. And so having that rapport and that engagement in the classroom is very important to me, especially since the majority of the courses I teach are online. Being transparent is also very important. And I was introduced to the TILT framework (Transparency in Learning and Teaching). And as an English instructor, and as an online instructor, I have to give very clear guidelines to students, because I’m not in the classroom with them. So they have to be able to read the guidelines and follow them. And so I’ve always been pretty good at writing those assignments and getting that across. I’ve tweaked it over the years, being more intentional about letting them know the reason why we’re doing this assignment. I’ve never been a teacher to have like a bunch of readings just because we should have a bunch of readings. Whatever unit we’re in in the English 101 class, I want the exercises that we do in these classes to help them in their final destination of that research essay that they’re putting together for the course. And then the fourth principle has to do with the UDL implementation. And that’s really having that plus-one mindset. Adopting a plus-one mindset is really important, because there’s always one thing that I can do, maybe I’m just doing one thing this week, maybe I’m doing one thing a day, maybe I’m doing one thing a semester, but there’s only one way to improve my curriculum. There’s always one way to improve meeting students’ needs.

Rebecca: So for folks that are interested in that plus one mindset, it’s introduced in Reach Everyone, Teach Everyone by Tom Tobin and Kirsten Behling.

John: And we do have a podcast with Tom that we’ll share a link to in the show notes. Maybe you could talk a little bit about how you’ve implemented some of those UDL principles in your class, as you’ve continually done the plus one thing.

Jeanne: Well, they talk about multiple means of representation, multiple means of expression and multiple means of engagement. So I’m always looking at my curriculum and thinking, how can I better represent, how can my students better express what they know? And how can we improve engagement? For multiple means of representation, I started revising my syllabus, first of all. I tried to use more inclusive language, a little more colloquial, a little more warm, not having these really strict rules, but kindly sharing what was expected of students in a tone that reduced that imposter syndrome, telling students directly in my syllabus “you belong” is important. Another thing that I did, I learned about how to create like a visual graphics syllabus. For example, for my English 101 class, we have four papers that students write. And so on one page, I outline the entire course with what the whole course will look like and some of the things that they’ll be learning. Under each paper, I would talk about specific skills that they were going to pick up under that paper, during that unit. So they could see the entire class on one page. It will list the papers and what percentage they’re worth. And it’ll list a little description of what is involved. Our final paper in the English 101 class is a career analysis project. And so day one, I want them to know, “Hey, you’re going to be writing a paper about the career you’re interested in.” So let’s start thinking about that. And so a lot of the scaffolding that I put in place from paper to paper helps students follow the general outline of the course. I also use a skeletal outline. When I teach a face to face course, I actually set it up on whatever learning management system I’m using in the class. I set it up the same way I would an online class. I do that because I don’t want to forget anything. But at the beginning of class, I can go over the page and say, “Okay, these are all the things that we’re going to get through today.” And students know, and they’re not getting restless in their seats, especially because I mostly teach night classes. And you can just imagine By seven o’clock how much they want it to be over. And thankfully, I don’t have a ton of content that I have to get through. And so it’s like a half discussion/lecture, half of the class is us working together. And the other half is lab time. And as part of like an inclusive teaching practice, during lab time I meet with students regularly, one on one. And again, I’m getting to know them, I’m finding out “How was work today?” But I’m also finding out “Where are you at with your writing practice today?” And if you put something in place for one student, every student can benefit from that. So like if I have a blind student who needs her readings to be audio, the mother who is driving her kid to soccer practice can also benefit from having an audio version of the text. I’ve really embraced that idea of, when I put something in a course, trying to give them a graphic, trying to give them the text, and then trying to give them an audio or audio-visual component. I use Zoom a lot to create my videos. And so we have the closed captioning, they have the PowerPoint, they have the option of reading the transcript, maybe all those things can be overwhelming, but then turn off the closed captions and just have the PowerPoint and the talking. A lot of times I don’t even have the PowerPoint, I just have the screen for the learning management system, which is not always smart, because I use three different learning management systems, so that I have to keep re-recording those videos.

Rebecca: It sounds like those alternative formats are really helpful for students in giving options to explore the content and giving variety. And it sounds like you’re guiding them through picking and choosing which format works best for them.

Jeanne: Absolutely. And in 2010, when I got my big start in online teaching, I had completed a master’s certificate in online learning through Illinois Online Network. And actually, that was the first time I had ever heard about things like summative and formative assessments. So I was using classroom assessment techniques or CATs to check in with students. So those were things that I was learning in this class that I didn’t know about, then fast forward to last semester, and now I want to learn more about universal design for learning. So I started a digital accessibility for educators certificate. And we had a course for the foundations, we had a course where we just learned the basics of manipulating documents and making them accessible. I did another course that did the same for videos, and then the full eight-week UDL course, but the videos was interesting in that they actually recommended that your videos only be two to three minutes long, which if you’re used to teaching an hour and a half class, how do you get a two-minute video to educate your students. And I think part of that is students are used to watching shorter videos. And so if you have a 20-minute lecture, chunking it into four different videos can be very useful, because even when they have to go back, they know that that information that they want to review comes from video two, or video three, and it breaks things up for them. And you can set them up where one flows into the next

Rebecca: You were just summarizing the different ways that you were implementing multiple means of representation. You’ve talked a little bit about multiple forms in your syllabus, you talked about skeletal outlines, and then you were just talking about multiple formats for lectures. So one of the other UDL principles is thinking about multiple means of expression or ways that students can demonstrate their learning. Can you share some of the ways that you’ve implemented that into your teaching?

Jeanne: Sure, well, again, because I teach primarily online, I rely very heavily on the discussion boards. And so I do definitely start out with the icebreakers. And it’s not a best practice to answer every student on the discussion board, but for the icebreaker I do, because I want them to know that I heard them and that I have a response for them. And so I really tried to be very intentional. And then as the discussion boards increase throughout the semester, I back off and let my students engage with each other. But what I love about the discussion boards is it democratizes the classroom, because if a student is put on the spot right there in the classroom, they can’t always process the information quickly enough. They might be shy, they might feel like they just can’t come up with the answer right then and there. But when you’re on a discussion board, a student has the opportunity to read the question and thoughtfully respond in their own timing. And that really matches the work that I do. I’m definitely better at creating courses in writing and using instructional design techniques to lay out my classes and have everything set up, do all the writing of assignments, I’m much better at the organization than I am at getting up in front of students and lecturing. That’s just what I’m better at. And so I can really understand the idea of having a new concept introduced to me, and then having the opportunity to really think about it, maybe do a little research and pull my thoughts together before I respond. And so I think having those discussion boards, sometimes I even integrate them in my face-to-face classes just to give students other opportunities to engage. I have a literacy narrative assignment, where I allow students to either write the essay, or use another modality. So like, every once in a while, I’ll have a student who will want to make a video, I don’t have all the techniques of what video software you should use. Sometimes having all that information can be daunting. In today’s age, you know, my son, he’s 21, so he’s a junior in life and he’s working in the trades. So he’s not in college. But he started using a Chromebook in sixth grade. So we have students now who have capabilities in video production that I don’t have, just because they’ve been doing it in their elementary, middle school, and high school classes. So I also have an option for them to create a comic. Because we have an example in our textbook where somebody wrote a literacy narrative,as a graphic comic. Every once in a while, I get the drawers who want to have their literacy narrative that way. And so again, there’s just multiple ways. Writing class, you can’t always have a video, students have to write. But I can sometimes give options, the literacy narrative is a great place to give students the opportunity to showcase their story using another modality. I provide examples whenever possible. I ask my students “Can I use this?” and I get more and more questions from students about, “Can I have an example?” And sometimes I don’t want to give them one, I just want them to respond. It’s a low-stakes assignment, and I want them to think. I don’t want them to see somebody else’s response. I just want them to tell me what they know. But especially for larger essays, I want to make sure that they have those examples. We read a lot of essays from published authors, but having examples from their peers, and especially examples from peers that had me as their instructor, can be very helpful to students being able to then turn around and express their thoughts in writing. And this is also where that TILT model comes in, because I want to tell them why they’re doing the assignment, the literacy narrative, the purpose is for me to get to know you as a student, as a reader, as a writer. It’s an opportunity for you to tell me your story, and what the actual prompt is, what the skills they need, there’s always a rubric for them to follow to guide them. I give them an idea of what I expect in the final product. And sometimes I’ve been learning more and more that sometimes, using specifications grading, it’s either you met the objectives, or you didn’t can be very helpful in some of these writing assignments. One of my favorite writing assignments is… I got this at a conference at College DuPage, like maybe in 2016, and I adopted it, and I’ve been using it for years, but only in the face-to-face classroom. It’s students pairing up to groups of two or three, and they choose a movie and they do their own version of “At the Movies with English 101.” I don’t know if you’re old enough to remember this, Rebecca, I know John is, but Siskel and Ebert At the Movies on Sunday afternoon, I watched it with my dad every week and so I get to nerd out a little bit and do things I love and show them all these different clips of Siskel and Ebert. And then they get to pair with somebody and watch a film and write a script that they present to the class. And so what I’ve learned over the years is that it’s not even really necessary to grade this assignment, because I’m really only grading on grammar and punctuation because they work so hard on it because they’re presenting it to their peers, and they’re working with another classmate that it’s a pure learning experience. And last semester, I had a student who was talking to her partner, and she said, “This is so fun. This is like doing a podcast.” And I thought, oh my goodness, I can bridge. I tell them to write a script and they look at me like a deer in headlights. But if I say they’re gonna do a podcast about their favorite movie, now I’ve reframed the assignment in terms that they understand. So that’s what I’m going to do next time. And like I said, if you’ve done the assignment, you get full credit because I’ve never had a student not do the assignment. I do have a rubric for the person who takes advantage, just in case they’re out there. And really the only way to lose points is if you don’t present your individual reflection on the entire process. So I feel like that is just one of those ways to meet students where they’re at by giving them the freedom to work with somebody else and see what kind of writing they can produce without too many parameters. And they’re almost always successful.

John: You had mentioned something about a career analysis project. Could you tell us a little bit about that?

Jeanne: Sure. That came out last spring, I had a late start class. And they were supposed to be writing an editorial and I was barely getting film analysis and literacy narrative essays from them. They were really struggling as a class. And I was trying to figure out a way to motivate them. And I’m thinking, if I have them write an editorial, that’s not going to work for this group. And so I scrambled, and I thought, well, as a freshman in college, most of the students who take English 101, this is their first time in college, and thinking about the TILT model, what can they write that gives them purpose? And so I came up with “Well, every student’s going to want to get out of college with a career, and we can still meet the learning objectives in the class.” So the final product is the actual essay, and that is totally graded with a rubric and they have to meet all the learning objectives, work cited page, introduction, thesis statement, all those components of a basic essay, source integration, synthesis. We’re in the early stages of getting them ready for that English 102 class. And so they can write an essay about their career meeting all those objectives in the same way that they could write an editorial meeting those same objectives. And so I always start a paper like that with an annotated bibliography. And so I got the librarians to help me find websites where students could research their careers. And so the librarians put together a page for me that students can refer to, and I’ve since created short videos, where I explain the different databases to them. Right now, I think I have like a 12-minute video that I did. So the next step is, instead of talking about all the databases in one video, talk about different individual databases in two to three minutes, breaking that down and meeting them even better than I was with a 12-minute video. So they write their annotated bibliography, and that gives them an opportunity to work on MLA citations, work on summarizing, and thinking about how they’re going to use that material for the final essay. That’s part one. Part two is using ChatGPT to have a conversation, I call it a ChatGPT interview. And so now that students have done the research on their own, now they’re taking what they know and I give them a series of prompts. And I’m giving them the experience of using ChatGPT to inform their writing and the research. And so I’m not necessarily concerned about the interview. I’ve very recently learned that instead of them describing the process, they can send me a link to the actual interview. So it’s evolved from describing the process to: write an introduction, give me your link, and then write a reflection on what helped and what didn’t help and how you think this is a valuable tool in education, how you think that ChatGPT could derail you in your education. And so I know a lot of English faculty are very wary of AI in the classroom with good reason, because I’ve gotten a few of those papers. And I’ve probably gotten more than I think, and they’ve gotten under my nose. But it’s like the internet was 20 years ago. It’s a tool that’s not going anywhere. And so it is our responsibility as educators to introduce students to these tools and talk about the ethics of them. And so this is just an opportunity to kind of slip that in. And the feedback I’ve gotten from most students is “Oh, yeah, I got really good information. Some of it wasn’t accurate based on my research. I could tell from the tone of what I was reading that it was robotic, and I definitely wouldn’t want my writing to sound that way. But it was nice to put some ideas in and get some feedback from those ideas. So part one is the annotated bibliography. Part two is the ChatGPT interview. Part three is that final essay, and this semester, I’ve added a part four, because I wasn’t feeling like this assignment was robust enough. And I’ve also been in conversations about UDL, giving students multiple ways to express what they know. And so I actually went into ChatGPT and I put part of my assignment in it. And I asked him to write me guidelines for doing a media presentation. And so now they’re going to have to take what they’ve learned in their essay, or what they’ve written in their essay. And they have to take it a step further and do some kind of a PowerPoint or video or some kind of visual component, so that they can, I guess, bring what they know, it’s not just an essay, but they’re sharing it with the world in some respects, or they have something that they could share with the world. And so this will give me an opportunity to talk about portfolios, ‘cause some nursing students need those kinds of things. I know I did when I was in public relations, journalism was my major. And so I know when I got out of college, I needed a portfolio. And so this is just another opportunity for them to maybe have a little bit of fun with the content. And it brings them more into the 21st century. Our students, I’m sure many of them aspire to be influencers. They love their YouTube. So this is a way for them to live out that dream a little bit.

Rebecca: Sounds like an opportunity to think about audience as well.

Jeanne: Yes, definitely.

Rebecca: How have your students responded to these opportunities in the reconfiguring of this project?

Jeanne: They have responded really well, especially with this particular project, the feedback I’ve gotten is I really appreciated the opportunity to research something I need to know about anyway. And I appreciated that you created an assignment that I can relate to, that means something to me. Not every discipline can do that. But as a writing instructor, Comp 101, Comp 102, I do have a lot of flexibility with the content. And so I focus very much on the skills that students can attain… the Siskel and Ebert, they all are looking at me, like, I’m crazy for asking them to create this podcast. But as they go through the process, I give them a lot of time in class. And as they go through the process of creating the document, at the end of the day, they have another piece of writing that they’re really proud of. A lot of them say “I had fun doing this.” And I feel like if a student is having fun doing a writing assignment, I’m really going to get to see their best efforts. I find that a lot of kids come out of high school and they come to college with this idea that I have to write what my teacher wants me to write. And I have to figure out what that is. And during the pandemic, I really got a taste of that when I was helping my son with his research paper, because he didn’t really do any writing. He started by looking for quotes. And then he explained what those quotes meant. He started with main ideas, and then he’d find quotes, and then he’d explain the quotes. And then he’d slap in a bunch of transitions and call that a paper. But there was really no like, “What do I think about this?” It was more about how do I meet all the criteria that my instructors have given me to complete this assignment. And so it’s a real privilege in English 101 to be able to kind of deprogram that thinking and give students the opportunity to really know what it’s like to write what they think,

Rebecca: Maybe to move on from just efficient solutions to things to something that’s actually valuable to them.

Jeanne: Exactly. And they’re learning skills in high school for a reason. They just lack the opportunity to really put those skills together in a lot of regular classes, I think. It’s been my experience with my kids anyway, and with my students, that they are really just re-imagining graphic organizers and presenting them to their students with all the boxes checked.

John: In your professional development role have some of the techniques that you’ve been using been widely adopted at your institutions?

Jeanne: Well, at Waubonsee, they pay for faculty to take the ACUE courses, which is a certificate in effective college instruction. And I know that there are a lot of active learning modules, there’s modules that have to do with creating a classroom environment that is conducive to learning. And there’s also a course that’s separate from the effective college instruction that is fostering a culture of belonging. And so that is a really good course to get people thinking about those around them. And at College DuPage, I do a lot of book clubs. So that’s how I got introduced to Thomas Tobin’s work, Reach Everyone, Teach Everyone and Flower Darby’s work with Small Teaching Online. And in fact, Thomas is the one who introduced me to John, at one of his sessions. So I’m a little bit of a Thomas Tobin groupie, I guess. And so I do find that any opportunity for faculty to engage with each other is really key. I know this as an online faculty member, I know this as an adjunct faculty member. I probably spent a good 10 years in a silo while I was raising my kids, and developed very slowly as an instructor, because I was really just doing my own research and learning my own things. But bringing it out into the world and engaging with other people, it really does improve your teaching strategies and your abilities at a much faster rate. And so I have really enjoyed the privilege of working in faculty development and sharing the things that I’ve learned with others and constantly also learning from others.

Rebecca: That is one of the benefits to being in faculty development, is getting the opportunity to learn new things, and from other faculty and other developers on a regular basis. I think that’s one of the reasons why John and I like to do the podcast. [LAUGHTER] And that’s why I enjoy listening to the podcasts, too. I go in these stages where I just listen and listen and listen and listen and listen, and then I burn out and I gotta stop, or I think, “Okay, I’m not listening to another podcast until I apply something from the last one I’ve listened to.” Because you know, when you’re in the car, and you’re just driving around, it can be really easy to think, “Oh, this is great, and then you forget about it.”

John: And that is a bit of an occupational hazard for being a podcaster in this area. Because there’s so many great ideas that we hear from people that it’s really tempting to try to do all of them. And that can be quite overwhelming.

Jeanne: For sure.

Rebecca: So, we do always wrap up by asking: what’s next?

Jeanne: I know and I keep thinking about that. My faculty development job is supposed to end because it’s a two-year fellowship, supposed to end in May. And so what’s next is there has been talk about keeping my fellow Adjunct Faculty Development Coordinator and I on staff. So I guess we’re waiting to figure out as we revamp that department if I will continue in faculty development. But the good news is I love teaching so much. And I love teaching online so much. And one thing that I’ve learned about the anxiety that I have with teaching in face-to-face classes is that I don’t do it enough. And if I do it more, that anxiety dissipates, because I’m in that community. So I don’t know what’s next.

John: Thank you for joining us. It’s been great talking to you again, and we look forward to hearing more about your continued evolution in terms of teaching.

Rebecca: Thank you for sharing your story.

Jeanne: Thank you so much for having me on. This was great.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

333. High Structure STEM Classes

Multiple studies have found that increasing course structure reduces equity gaps and provides benefits to all students. In this episode, Justin Shaffer joins us to discuss several ways to increase structure in STEM classes.

Justin is the Associate Dean for Undergraduate Studies and a Teaching Professor in Chemical and Biological Engineering and in Quantitative Biosciences and Engineering at the Colorado School of Mines. He has taught a variety of both small and large STEM classes in multiple modalities using evidence-based approaches and has won multiple teaching awards as a result of this work. Justin is also an active researcher with 16 peer-reviewed publications and serves as the editor for four STEM education journals. He is the author of a forthcoming book on high-structure course design coming in late 2024 or early 2025 from Macmillan.

Show Notes

Transcript

John: Multiple studies have found that increasing course structure reduces equity gaps and provides benefits to all students. In this episode, we examine several ways to increase structure in STEM classes.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca:Our guest today is Justin Shaffer. Justin is the Associate Dean for Undergraduate Studies and a Teaching Professor in Chemical and Biological Engineering and in Quantitative Biosciences and Engineering at the Colorado School of Mines. He has taught a variety of both small and large STEM classes in multiple modalities using evidence-based approaches and has won multiple teaching awards as a result of this work. Justin is also an active researcher with 16 peer-reviewed publications and serves as the editor for four STEM education journals. He is the author of a forthcoming book on high-structure course design coming in late 2024 or early 2025 from Macmillan. Welcome, Justin.

Justin: Thanks for having me. I’m really excited to talk to you today.

John: We met at the POD conference back in November, and we talked about doing this but we finally got around to actually scheduling it. So thank you for joining us.

Justin: Thank you, John. Yeah, I saw you sitting there at a table by yourself. I knew your face from LinkedIn and I built up the courage to introduce myself and I’m glad I did.

John: Today’s teas are:… Justin, are you drinking any tea?

Justin: I am drinking some tea. I got prepared. It’s from a small little coffee/tea shop in West Middlesex, Pennsylvania. I’m from the near that area in western Pennsylvania. We call it the Shenango Valley and it’s called O’Neill’s and they make lovely Western PA coffees and teas and I just have some nice black tea here. It is that time of day for me that I need some.

Rebecca: Today I have a jasmine green tea, John.

John: Very good, and today I have a Prince of Wales tea, and a peppermint tea because I didn’t have very much to drink today, and my throat was getting really dry in my econometrics class. So I wanted to be well hydrated. [LAUGHTER]

Rebecca: Lots of variety, too. So we’ve invited you here today, Justin, to talk about how you’ve implemented high-structure course design. And for listeners who might be new to the concept, can you talk a little bit about what you mean by high-structure course design?

Justin: Yeah, so just like I’ll tell you all like I tell my students, I didn’t come up with this term. I wish I did. But I’m building off the work of other giants in the field. So as far as I know, the term really came out in the mid-2000s, 5-, 6-, 7-ish range from the University of Washington in Seattle. There’s some pioneering folks, Scott Freeman and Mary Pat Wenderoth in biology and they use this term structure to think about, “Well, how do we scaffold student learning before class, during class, after class, and we’re continuously building as we go up through the three levels.” So pre-class involves some kind of content acquisition, that can be reading your textbook, reading journal articles, watching Khan Academy videos, other sources like that. And then some kind of formative assessment before class because we all know students need a little bit of a carrot there to get some of that work done sometimes, which is totally great, because you give them a lot of chances, sometimes even unlimited attempts… again, formative assessment before class, make sure everyone has the same solid foundation, then you come to class, high-structure course design, just like any good class nowadays should be really rooted in active learning. So we got a lot of activities going on: group work, problem solving, case studies, real-world connections, any kind of flavor you want to do there with your active learning as long as students are engaged. And the big thing here though, is that you’re aligned to what happens before a class. We’re building off what happens before a class, I’m not in class just repeating what happens ahead of time. Rather, I’m using the foundational material students acquire before class, we build that up with another level in class, and then we keep going. And then after class, there’s a bucket there, where students are going to be practicing those skill sets they’ve been developing through the before class and in-class buckets, applying their skills to new contexts, solving new problems, doing projects, essays, more authentic assignments, whatever you want it to be. And then there’s typically a frequent assessment piece with a high-structure course design too, whether that’s a multiple midterm model, weekly quizzes, every other weekly quizzes, things like that, in addition to some more authentic assessments, which is something I’ve tried to get more into this past year, by adding more realistic projects and course assignments in my high-structure courses.

John: Could you give us some examples of some of the authentic assessments that you use in your classes?

Justin: Yeah, thanks, John. So this is really new to me still, this past year. I know I’m behind the curve. I know this is a term has been around there for a while. I always like to think I’ve had some authenticity in my classes for a long time. I integrate news stories, I use case studies, I have this new thing I called pod cases where I take podcasts and combine them with case studies and we use those in the classroom. But I thought I could try to be a little bit more authentic, even still… getting that advice from my wife for my personal life. She always says that can be more authentic. So, maybe I can make my courses and my assessments more authentic too. One example I’m doing right now. I’m teaching introduction to biomedical engineering, and I’m having the students write the actual legit National Science Foundation Graduate Research Fellowship proposal. Those of you familiar with that, there’s a personal statement part and there’s a technical kind of research proposal part. So we’re just doing that. It’s a two-page proposal, and we’re working on this in a structured way throughout the entire semester. Last week, students had to turn in the research topic and research question. This week, they’re turning in their hypothesis, in a couple weeks they’re turning in the literature review and experimental plan. We’re gonna have two rounds of a formal peer review of the entire proposal. And then we’re going to conclude with a mock panel discussion, just like you might have in the real NSF or the real NIH where students are going to be reviewing each other’s proposals and basically pitching them to each other and seeing if they should get, quote, unquote, funded or not. I don’t have any funds for them. Maybe we’ll bring candy on the last couple of days. But that’s kind of the idea of having a real thing that students could actually use some day if they’re going to graduate school. But even if they’re not, being able to write technically and persuasively in two pages on a proposal is a really important skill that they should be working on, in my opinion.

Rebecca: Sounds like you’re going to need some chocolate coins for that day.

Justin: That’s a great idea. I will get chocolate coins. [LAUGHTER] I didn’t think of that. [LAUGHTER]

Rebecca: Can you talk a little bit about what motivated you to attempt and move in the direction of high-structured course design.

Justin: I kind of started out this way, I kind of started in the deep end, if you will. So my postdoctoral program was called spire, S-P-I-R-E, and it’s one of these bigger programs called IRACDA through the NIH. They’re postdocs where you still do research. So I was a molecular biologist, biochemist at the time. I have a weird background in chemical engineering, bioengineering, molecular biology, but at the time, I was studying muscle proteins in squid, super fun stuff. And then I also got training, though, on how to teach evidence-based college science and engineering courses. In my postdoc, through great people like Ed Neil, Brian Ray Bozic, Leslie Lauria, and then also Kelly Hogan was someone that took me under her wing at the time, she was able to, along with the rest of the SPIRE team, helped me be introduced to using evidence-based course design practices, which included with high structure. So this was around 2010-11, right when these papers are starting to come out from Scott Freeman and Mary Pat Wenderoth. I started with high structure because the evidence shows it works. And that’s as a trained scientist, as a trained engineer, we like to go with evidence ideally to guide our decisions. And it’s no different with course design and teaching as it would be with thermodynamics or reactor design or anything else. The literature on high structure is really strong, even then it’s been growing over the years, some of my own data and a lot of other papers. The main gist, though, is that by having the scaffolding before class, in class, after class, students are able to really monitor their learning, develop self-regulated learning skills, be more metacognitive. And the data in a lot of papers shows all students are doing better in the class. But it’s not just everyone, using high structure and moving up in structure will start to close or reduce achievement gaps or performance gaps between historically underperforming students and their majority counterparts. So for example, female students and male students in physics, there has traditionally been a gap there, add some more structure to the class, those gaps tend to get smaller. And I’ve been participating in that kind of research here over the last many years with undergraduate students and my research team. And we found some similar results across different STEM disciplines. It’s really the evidence guiding me in these decisions to do it. I also think it’s a lot more fun. Once I have in mind one of my very first faculty interviews, oh a long time ago, now, I had an interviewer say to me, “Well, hey, I’ve looked at all the papers on active learning, and they’re all wrong. [LAUGHTER] All the statistics are wrong. What do you have to say about that?” And I paused for a second I said, “Well, even if that’s true, it’s a heck of a lot more fun to teach actively with active learning than not, I think the high-structure design model is more of a fun way to teach. And again, you’re helping the students with those study skills and metacognitive skills that they can then take forward to their future classes.”

John: There was a recent paper that did argue that many of the studies on active learning were flawed in some way in terms of a very strict methodological approach. However, there are so many of them, and the results are so remarkably consistent. I don’t really buy that argument in terms of the questions about methodology.

Justin: You’re right, it was a big deal, I think it was either Beckie Supiano or Beth McMurtrie in the Chronicle had articles on this going around for sure. And that’s the thing though, with us, as DBER folks… I want to introduce a new term, DBER – discipline-based education researchers… which I consider myself to be in. So I’m in the discipline. I’m in chemical engineering, I’m in biology, I’m in Biomedical Engineering, and I do the education research from that lens, but also from that training background. I’ve never been formally trained in education research methods in psychology or social sciences or psychometrics. I am, totally honest, I fake it. I do what I can. I know my boundaries. I know when I need a collaborator in the true social science disciplines that helped me with my studies. And so I think that paper was getting some of that. Sometimes the folks like us that are doing this work, whether we call ourselves DBER people, or Scholarship of Teaching and Learning (SOTL) people, we might not have that true background, and therefore the rigor of the paper, the methodologies, aren’t as advanced as maybe they should be. But like you said, there’s so many studies showing benefits of this, whether it’s simple correlational studies… sometimes they get to the mixed methods, even quasi-experimental studies, but the evidence just keeps mounting and mounting and mounting. And that key paper there was the 2014 one from Scott Freeman that PNAS meta-analysis showing that hundreds of papers, hundreds of studies… again, they have their flaws, don’t get me wrong… but you start to see these themes everywhere and you think, well, there must be an effect, something’s going on.

John: And we will include a link to that paper in the show notes, if anyone would like to follow up. But the fact that there may be these flaws in some of the research methodology suggests that maybe we need to see more people doing work in this area, and that there’s a lot of areas where there’s potential growth.

Justin: Totally agree.

John: And you’ve done quite a bit of research already.

Justin: I’ve tried, as a teaching faculty member now for this is going on year 12-ish, but I’ve always made that a part of my career. Before I was at Mines, I was at University of California, Irvine, where we did have a scholarship expectation or to earn tenure as teaching faculty. The UC system is one of the few in the country where you have actually tenure-stream teaching faculty, which was really cool. So I earned that, but I only had tenure about a month because then I left and came to Colorado, which… no regrets, I love it here at Mines… but I don’t have tenure here. But there’s still some expectations for scholarship, but not as high as it was in the California system. But I continue to make that part of my career, because, again, as a scientist and engineer, I think going based on data, based on evidence to guide your decisions, moving forward is a really important thing to improve what you have, because that’s all it comes down to really whether you call it SOTL or DBER or whatever, we’re trying to improve our courses, we’re trying to improve our students’ experiences. And yeah, so I’ve tried to do what I can over the years. And now I’m at the point where I want to help other people too. So I work with faculty individually, I do workshops via my side business, and even at Mines this semester, starting next week, I have a three-part getting started in DBER series kicking off for about 25 faculty on campus. I’m going to help them get started, get their feet wet in this field, and then we’ll see where it goes. Because I think a lot of folks, like you said, John, want to do this work, they’re interested in it, they might not have the time, they might not know how to, but you kind of give them the start, hold their hand a little bit and then see where it goes, and we’ll get even more evidence to support these claims.

Rebecca: I think a lot of faculty have an inclination to have a reflective practice and continuous improvement. They’re wanting to do SOTL work, but just don’t know how to formalize that practice. And we can certainly lean into helping people move in that direction.

Justin: 100% Rebecca, even when I started, I didn’t know what I was doing. If it wasn’t for Kelly Hogan and a few other folks at Carolina and then moving on from there at UC Irvine folks like Brian Sato, Diane O’Dowd, Adrianne Williams, they really helped me understand the field more. And then you start going to conferences and going to meetings and learning more about the tricks of the trades.

Rebecca: Can you talk a little bit about ways that a high-structure synchronous course might be different from a high-structure asynchronous course?

Justin: So I think the high structure while what I described earlier, you might be thinking of okay, a Monday, Wednesday, Friday class meeting at two o’clock in a lecture hall works great. I think it works even better in online for some cases, because you think about an online situation, whether again, it’s synchronous or asynchronous, your students you’re not really seeing and there’s that human connection of having eyeball to eyeball being able to understand, “Okay, I’m here I’m motivated, I’m ready to learn.” But whether it’s the recording, that’s the worst case scenario, when it’s totally up to you, or if it’s going to be on that live Zoom remote, where you can make your screen black, and who knows what else you’re doing. I’m guilty of that in meetings for sure. But having the structure though, having that scaffolding, having the clear deliverables of what is due when and seeing that step up from pre-class, in-class, after class, whether it’s the in-class is out again, synchronous Zoom session, or the recorded video you do on your own time, there’s that scaffolding helps students stay more connected with material, they understand more of what’s going on, when it’s due, what is due, how I’m being assessed, because that’s the nice thing about with structure. And just to be clear, I’m from the STEM disciplines, but you could do this any field. The research on high structure, as far as I know, is only been published in the STEM fields. I bet it’s being done in art history, I bet it’s being done in the languages, I just don’t know about it. So if anyone listening does this kind of teaching or research, I’d love to hear from you. But you can use that scaffolding again to help students be more transparent with the course. And that’s a word that I think comes through with high structure and is really true in that online environment, especially as transparency. I always tell my students, I want to know what you know, not what you think I want you to know. And by being uber clear with the learning objectives, starting with backwards design, just a clear Canvas website for the online cases can be really helpful for that. One distinction, though, with the async online versus synchronous online, is that kind of active learning piece, because we’re not there together. So one tip I like to share with faculty is that okay, if you’re recording a video for the in class, mimic, because you’re not actually meeting in class. What I always say is “okay, well make the video, but if there’s a point where you’d want them to answer a clicker question… I’m a big clicker guy… or if you want them to do an activity, just say, Okay, everyone, pause the video here. Take a couple minutes, think about this problem, what’s the answer or work on this, whatever it might be. When you’re ready, unpause the video and keep going. That’s a way that you can add the active learning to an online asynchronous class as part of the bigger high-structure model. I find when I have to record an online video, if I have traveling for a conference because I have to miss a day of class. I’ll have a 50 minute in-person class, when I make the video recording it’s only about 20 to 25 minutes, because all the active learning I don’t do in the video recording, but I give that tip… I tell my students, hey, pause the video here, answer this quick clicker question, solve this problem, come back when you’re ready. And so that’s a way to build the active learning into the asynchronous part, which again, is part of the overall high-structure piece.

John: And also, if you want to take it a little bit beyond that, you could use one of the tools where you can embed the questions directly in the video, and have them auto graded. I use PlayPosit for that, and it’s possible in Panopto, and EdPuzzle is another alternative that many people use. PlayPosit works really well. And I’ve been using it for a couple of years.

Justin: I just learned about PlayPosit maybe three weeks ago, I was doing a workshop at CU Boulder on clickers. And I kept hearing PlayPosit, it does seem like a very powerful tool to automate that active learning in the video piece, which I really like. I just haven’t had a chance to play with it.

Rebecca: So you did just mention that you’re a clicker guy, I believe. So do you use a flipped classroom approach in all of your synchronous classes? And how are you using clickers in your classes?

Justin: Yeah, I think that’s the technical term these days, clicker guy. So, I’ll go with that. I’ve been using them for as long as I’ve been teaching in various platforms. You name the platform, I’ve used it. I’ve primarily been using iClicker, just because that was the platform we had at UC Irvine and the platform we have here at Mines as well. Yes, I love using them. I think it’s really important. And you mentioned the flipped classroom design there, too, Rebecca. So when you think of high structure, you might think, “Oh, it sounds like a flipped classroom.” And it kind of is because we’re having students do stuff ahead of time. In class, they’re very active, but there’s still that structure piece even within class. I guess maybe I haven’t seen a truly flipped class because I think flipped classes, I think in class is like purely work time, purely activities, purely worksheets, homework type assignments, whereas I do a series of clicker questions, discussions before or after numerical problem solving, if it’s more of my engineering classes that I teach in thermodynamics, or material and energy balances, more conceptual sometimes if it’s biology or anatomy and physiology, but I’m breaking up a lot of activities and any talking with clickers. And so the clickers… I love all the modern bells and whistles that they have as that’s the another technical term I use, moving beyond multiple choice. And when I do workshops for faculty with clickers, that’s what I triy to get them to do. Okay, yes, you know, you can do A B C D E, but can you do multiple answers? Can you do target questions or hotspot where you touch the screen? Can you do ranking or ordering? numerical answers? …and I’m trying to get this traction on my own campus too. So even this semester, my first five questions of the semester, which I didn’t do intentionally, but after I wrote them, I realized, oh, I should do this every class now… my first five questions in my introduction to biomedical engineering class, each one was a different question type. So we did multiple choice, we did multiple answers, we did short answer, text entry, we did numerical, and we did target or touch the screen. And when I was done, I asked my students, “Hey, who’s ever used those other question types before?” And maybe four hands went up, I said, “Cool. What class did you do them in?” and they said, “Oh, your class last semester.” I seem to be the one and only that I know of on my campus that’s trying out these other tools, although like I said, I’m trying to change that. So yeah, if you’re using any kind of device like this, any type of ed tech, for that matter, make sure you justify it, justify the cost, and you make use of those bells and whistles in class. Or if it’s out of class, courseware, whatever it might be, just make good use of the tool, and you’ll find your students that are going to be able to buy into it and use it more effectively, and hopefully learn more from it.

John: And one option that we have here is a campus license, which actually is much less costly per student. And that reduces that barrier of students having to pay for it, which has led to a pretty rapid expansion in the use of it on campus.

Rebecca: One of the things that I really like about your example of the five questions is that extra level of scaffolding, of introducing all of the question types right away, and giving everybody an opportunity to practice those question types that you’re going to be using all semester. And so I just wanted to make explicit that other layer of scaffolding that you have built in there.

Justin: Yes, teaching students how to use the tools is very important. Thanks, Rebecca, for mentioning that, because whether it’s the app now on your phone for these clicker devices, or if it was the old physical device, there’s a learning curve with them. And same thing, even if it’s computational tool, or like Desmos, or something for a calc class. Yeah, you got to be able to teach students how to use the technology properly first, before you expect them to use it well. I will say though, with the learning curve of the clickers, when I was at Irvine, the app wasn’t really there yet. So everyone had the physical iClicker remote, and this was the iClicker w, so you could do text entry, and you could do number entry, but you had these up and down arrows, which you had to click to go through the alphabet. So I do the type of clicker question where I like to give four statements on the screen, and I say, “Okay, well tell me if they’re true or false, and you have to click in all four.” So you would click in a string of T’s and F, so it’s like TTFT, or FFFT, whatever it might be. And so when I would do this in intro bio there with 440 students, it sounds like a swarm of locusts, all the clicking to get to the T’s and then someone says, oh, you should change it. Just make A be true and B be false? I said “Great idea, I’ll do that.” But now with the app, we lose the sound effects and iyou can just type in T’s and F’s and it’s a little bit easier to use.

John: One thing I haven’t tried with iClicker, and I do plan to do it this semester is allowing students to rate their confidence in their answers. Have you tried that yet?

Justin: I did just last week. So I just found out that was available this semester, and I gave it a shot. And it was kind of fun. Like the first day I turned it on, they’re like, Oh, look at this, this question was 80% confident, and now it’s down to 40% confident and it kinda reflected the percent answers that were correct. So like the one that was 80% confident it was a single multiple choice answer. And it was pretty much most people got it right. The one that was lower confidence, like 40%, was a multiple select answer. So they had five options, but two or three could have been correct. And so the confidence goes way down through a different question types even. So, I think it was really fun for a day or two, and then kind of the novelty wore off, unfortunately. [LAUGHTER] So I’m going to try to revisit it maybe more in targeted times and targeted questions rather than doing it for every single one. But it was fun to try it. I’d encourage you to do it, too.

John: One of the reasons I was considering it is that it might help students improve their metacognition a little bit by reflecting on how well they thought they knew something and then getting fairly immediate feedback on whether their expectations about how well they knew it actually matched the response, [LAUGHTER] or the feedback to the response.

Justin: Absolutely.

Rebecca: When you’re using clickers, are you also using strategies like think-pair-share as part of your implementation?

Justin: Yeah, absolutely. And there’s that sweet spot of clicker responses that lead to that. So the best practices, I’d say, and a lot of this work came from Carl Wieman Science Education Institute, which I believe is still housed through Vancouver, British Columbia, but he’s at Stanford now. But there’s this great flyer they made like this trifold flyer that kind of walks you through how to use clickers properly, or best practices suggested, and then what are the possible outcomes? Typically, you’d start off with that silence. Okay, click in on your own at first, I tell them I want to hear crickets, just click in by yourself, and then I’m able to see on the app the distribution and so at that point, there’s typically kind of three outcomes. So one is maybe 80-90% have the correct answer. At that point I’ll say “Okay, let’s move on.” But I make sure to take time to have students respond and say, “Okay, well, why is it C?” or to have a little discussion about why it’s not the other answers. Because even though you get 90% correct, there’s still 10% of students who got it wrong. So we want to make sure that everyone’s on the same board. The next option is usually that kind of random distribution. Let’s say if it’s a multiple choice question, you get ABCD each are in the 20 to 30% range. At that point, I call that Hmmm, what’s going on? Was it a really hard question? Did I goof the question? Is there a chemistry exam this evening, so there’s some reason why maybe it didn’t click? And then what I call the Goldilocks case is when you get the kind of 50-50. So maybe you’re split between two answers. And I love actually, when it’s exactly 50-50, I’ll show that on the screen. But sometimes I don’t, and I’ll say “Okay, at this point, now, you’ve all had a chance to try on your own, now talk to each other.” So that’s kind of the think-pair-share that’s built into the clicker there. So this is peer instruction at its best. This was pioneered by Eric Mazur at Harvard, people like Jenny Knight at CU Boulder have studied this. And she actually has a Science paper with Carl and a few others that showed when students are doing this… So you give them some quick information on their own. Don’t show them the answer, have them talk to each other. They put a bunch of microphones around the lecture halls at CU Boulder, and they listened into their conversations. And they actually found students are legitimately teaching each other and debriefing the topic, discussing it, tearing it apart. It’s not just the one student says, “Oh, it’s A ,everyone else, click A.” They’re actually debating it and talking about it, so that you get that true peer teaching and peer instruction going on. And then typically, you see everyone moving more towards the positive correct response that you’re looking for, at which point you can say, “Hey, look, you don’t need me as your instructor, you’re teaching each other. You’re doing great. Kudos, keep up the good work.” Yeah, there’s so many ways to riff on clickers and use them in different respects. Whether it’s the more traditional question types, or now the more advanced question types, and no matter how you do it, you’re getting students more engaged, they’re having more fun with it. And fun actually is a word they use with clickers. I have a paper a few years ago from the HABS educator where I looked at clickers vs. Kahoot!s, and students rated Kahoot! and clickers both equally fun, where Kahoot! being the more gamified version with trophies and a podium and music and sound and stuff like that.

John: And both Eric Mazur and Carl Wieman and some co-authors had done some experiments on the use of clickers with that methodology with answering it individually and then discussing it and voting again. And they found some really substantial learning gains in both of those studies. And we’ll include links to those in the show notes. In all areas, we’ve been seeing some significant equity gaps, but I think since COVID, we’ve been seeing much worse equity gaps in terms of students because learning losses were pretty pronounced everywhere. And that’s especially in math and in the STEM fields, but they were especially large in lower-income communities where schools were not as well funded and where students did not have the equipment and so forth, needed to thrive as effectively in remote instruction. One of the things that some institutions have been using increasingly is co-requisites in place of prerequisites to help students who want to pursue a major in a STEM field, but who would otherwise fall way behind or take many years just to get up to the basic level of math needed for the entry level courses in the discipline. In 2021, though, you had done a study that did a comparison between the effects of prerequisites and co-requisites. Could you talk a little bit about that study and what you found?

Justin: Yeah, absolutely. We saw the same thing probably everyone else did with students struggling, returning from online instruction in high school and having online instruction here. I taught remote synchronous for three full semesters, even though at Mines we stayed open for business pretty much the whole time with in-person classes, just lower capacity. I had prior online instructional experience in my career, so I volunteered to do those online sections for our department. But with the co-rec/prereq issue, I think that’s really important to consider for a lot of reasons. And this work really started when I was at Irvine with Brian Sato and Pavan Kadandale and a few others, looking more in the biological sciences and “do prereqs matter?” It was kind of our big research question. And then I carried that over to Mines and applied that to chemical engineering too. The short answer is: it depends. So first of all, and kind of why do we even have prereqs or co-reqs? A lot of it seems to be more of a management thing. So if we want to control class sizes, moving from first year to second year, and so on, and so forth. But there’s definitely an idea of well conceptual understanding and carry forward for if you have Bio I, well, those skills you develop could be used and count for something when you get to Bio II or same thing with the calc series or whatever it might be. However, we don’t know. It’s unfortunate that I think programs don’t sometimes look at those connections, that vertical alignment, if you will, between courses in terms of prereq to the following class, or with the co-req issues. At Mines, what I did with the paper you’re referencing, John, in chemical engineering, we have these two courses. One is called material and energy balances, MEB, I’ll call it for short. And that’s kind of like our intro bio version for chemical engineering. It’s kind of like a survey course that covers a lot of different topics, gives you some foundational skills that you’re going to need as a chemical engineer. We also have introductory thermodynamics, and an intro thermo, it’s related to MEB, covers some same conceptual understanding and problem-solving skill development, but it’s more on the nature of energy, and that transformation understanding. So typically in chemical engineering curricula, and I’m getting in the weeds here, so apologies for anyone who’s tuning out cuz you’re not a chemie, but MEB comes first, that’s typically either the fall of sophomore or spring of sophomore, you take that. First, it’s kind of like your gateway class, and then that’s a prereq to intro thermo and everything else you take. At Mines though, we do a little bit different. Mines, we do intro thermo first, fall of sophomore year, and then in the spring of sophomore year, you take MEB and coming from that background myself as a student at Penn State, I wish I would have had that way because intro thermo is the more… I use the word gentle… it’s a gentler introduction to chemical engineering than material energy balances is. But the idea here is that you can take thermo as a prereq in the fall or as a co-req in the spring with MEB. So the natural question came up… it’s a nicely well organic experiment to test is, well, if you have the thermo as the prereq do you do better than if you take thermo as a co-req with MEB. And this has implications for advising and its implications for progression through our major through repeating classes, all sorts of things. So it’s a really worthy study and my student, Jordan Lopez, at the time, he was an undergraduate student in mechanical engineering, and I love working with undergraduates on these SOTL and DBER projects. Jordan came along with me for this we did a quantitative assessment to figure out okay, well if students in MEB, did you have thermo as a prereq or co-req? How’d you do in MEB? And then we also asked the students qualitatively “Okay, well, do you think having thermo as a prereq or co-req matters? And if so, what do you think? And what we found was there was actually a big deal. Students who took thermo as the prereq did significantly better in their overall course performance in MEB than if they took thermo as a co-req, and that’s using linear regression models controlling for incoming GPA and things like that. Students also felt the same way. They felt that if you have thermo as a prereq, you would do better than having thermo as the co-req with MEB, and again, the quantitative data bore that out. The reasons they gave for that was because they get some opportunity to get more familiar with the discipline, with how we approach chemical engineering, how we do problem-solving skills, and having that foundation in the prior class allows them to do better in the follow up MEB course. In this case, it mattered, prereq vs. co-req. However, in our studies at Irvine, with Brian and Pavan and others, we found it didn’t really matter so much whether you took for example, microbiology lecture before after microbiology lab, you would think those two would be highly correlated one as a prereq to the other, it didn’t really matter in the result. Same thing with anatomy and physiology sequences, it didn’t seem to matter too much, in other papers in which we cite in these studies looking at organic chemistry sequences, economic sequences, it’s kind of hit or miss with whether prereqs matter or not. Long-winded segment here, but I think we as programs should be taking careful look at our prereq sequences and core sequences in general to see what, if anything, our students carrying over from one course to the other, and maybe we should loosen that up a little bit, because if they don’t matter, that can help students be a little bit more flexible with their degree planning, and time to graduation and things like that.

Rebecca: Speaking of prerequisites, faculty are often complaining that students don’t necessarily recall [LAUGHTER] information from prerequisites as they go into a sequence like we might expect. In 2018, you conducted a study that investigated the effect of physiology prerequisites on the future anatomy and physiology courses. Can you talk a little bit about that study and what you found there?

Justin: Yeah, so that was what I was alluding to there, Rebecca, with some of the work I did with Brian and Pavan. And in those cases, there wasn’t too strong of an effect, if anything, with the sequencing and the ordering that students took these classes. At Irvine, we did have human physiology as a prereq to human anatomy. I know that sounds a little funny to those of you in the A&P space. But the reason we did that was because of kind of a controlling the size of things. Our physiology course there was a lecture-based course, it would have 3-4 hundred students in it every quarter… talking about over 1000 students a year taking this class, versus the anatomy class, which had a lab, we can only handle about 144 per quarter, so availability of seats in the human anatomy was much, much lower than physiology, and also not as many students wanted to take anatomy versus physiology. So that’s kind of why that ordering existed. And so we tested that, though, looking at with what Brian and Pavan and I came up with, we call it a familiarity scale. How do you do on questions that are based on how familiar you are with the content based on the prereq? What we did was we had the prereq instructors look at the follow up course exam questions and write them as very familiar or not familiar based on basically whether it was covered or not. And then we looked at student performance on those questions based on having the prereq or not, and we didn’t see much of a difference based on the very familiar versus not familiar questions. The way we designed those studies, we didn’t come up with any strong conclusions, again, on the biological sciences side saying that, yeah, these prereq sequences matter. But on the chemical engineering side, which I just described, that seemed to totally make a difference, the ordering of the classes.

Rebecca: It seems like it’s really important to think about why we’re structuring the curriculum in the way that we are. And is it just traffic control? Or is there actually a legitimate reason why we’re hoping that they are scaffolded in the discipline?

Justin: Yeah, I think it’s reality, a little bit of both that happens, which makes sense, kind of have that traffic control, but also making sure that that alignment occurs through our new programs or existing programs, and just taking the time as a program or department every so often to say, hey, let’s look back at this and see, why are we doing it this way? Things need to change in this modern day.

John: One thing I wonder a little bit, though, when instructors are complaining about how little students remember from the prerequisite courses that they’ve taken earlier, is how much of that may be due to the incentives provided to students. The way many courses are structured, not in the sense of the structure you were talking about, encourages students to do a lot of cramming before the high-stakes exams. And we know that that results in very little long-term recall. Might some of these issues be resolved if we could encourage students to adopt better learning strategies, and if we could design some of our courses at the lower level, perhaps, to build that in, using the type of structure that you’ve been talking about? Because at least from what I’ve seen, that’s not so common? You picked up this stuff fairly early, but I don’t think that’s part of the training of most of the faculty in STEM fields or in most disciplines.

Justin: Yeah, I agree with that. And there was even in 2018, I believe, in Science, a paper, I think they call it “The Anatomy of STEM Education in North America,” it was something along those lines, where they looked at a big survey a big swath of courses and trying to see who’s using Active Learning who’s not, they use the COPUS protocol, the observation tool to characterize what’s happening in the classroom, and they broke it down in these seven different buckets. And even at that time, a very small percentage of the courses surveyed in STEM were taught using these student-centered strategies, not necessarily high structure, but the active learning, student-centered ideas. But I completely agree with you, John, if we can get more faculty on board with using these types of evidence-based practices, which yes, it takes some time, takes some energy, takes some foresight to develop these courses. But you do the same thing with your research, it takes your time and energy and careful thought to put in your research experiments. We should put the same energy into our classes too. And if we can do that at the early stage, which again, there’s such a huge issue with loss of learning. Not only that, but also lots of students from the early stage. There’s a paper after paper for these bigger courses, taking them as quote unquote gateway classes, we get a lot of attrition at these levels especially of students who might not be as well represented in STEM. We can add high structure. We know that works. We know that helps students do better and succeed. It might not work the first time, don’t get frustrated everyone. There’s a great paper from Anne Casper and Scott Freeman about having True Grit with being able to try and try again. So in her case, she tried adopting high structure at a smaller school in Michigan, it took her about three tries to get the right formula for it to work for her students to see success. And that paper documents that trial and error over a few semesters. But if we can use these types of methods in our classes, ideally, our students are going to be better prepared then for future classes. I do these things called Reading guides, which again, another shout out to Kelly, I got a lot of inspiration from her at Carolina for these, these are just Word documents that I make. And I have a bunch of these on my professional website. If anyone’s interested to download them for free, go for it. They’re just Word documents that help students read the textbook and again be more transparent with what I want them to know. So it has them define terms, fill out tables, make little drawings, they answer checkpoint questions in the text, summarizing things in their own words. And with the reading guides, we’re able to help students again acquire that content and then use it in the class as needed. I’ve had students in follow-up classes say to their instructor, “Well, where the reading guides at?” And they’ll come to me like, “Hey, what are these things? What are they talking about?” So the point being with that story, though, is that I tell students that “Hey, even if you go to a follow-up class, where it’s not highly structured, you’ve developed so many great metacognitive skills, you’ve developed so many great self-regulated learning skills through this class that you can then apply it and add your own structure to follow-up classes, if needed. And these are the kinds of tips that I love working with faculty about to try to help them transform their classes when I visit a campus and do a workshop or work with faculty one on one or on Zoom or whatever, trying to take these practices, which again, are rooted in the evidence, they’re rooted in the literature, but we have to tweak them to your own personal situation, your own student body, your own courses and demographics and everything. You all know your students way better than I do. What I try to do is combine what I know from the literature and the evidence. And that says a lot of this is in the book I’m writing on high structure, it’s going to guide you through the course-design process, a lot of practical outcomes and deliverables. But you got to tweak it and match it with again, your unique circumstances to achieve those positive outcomes.

Rebecca: I think one of the nice things about introducing students to some strategies for high-structured learning and retaining information is that if you have things like your reading guide, and they show it to another instructor, now they might request that of their instructor and the other instructor might decide, “Hey, this is a good idea. This is a strategy I want to adopt too.” And that’s some of the best ways to get some of these techniques to spread.

Justin: It really is. It’s that camaraderie building through seeing each other’s practices, seeing what’s going on. I’ve been part of a project here at Mines since I got here almost six years ago now where we’ve been working on kind of revising how we evaluate, and what we consider effective instruction to be. So we’re trying to take a more holistic review of how we take into account the best practices of teaching and student learning. And one of the big pieces there is peer observation. So we’re actually rolling that out, as of this week and last week with doing departmental trainings and helping faculty see how we can do peer observation to learn from each other. I learned so much from going into another person’s classroom or looking at their Canvas site, or their syllabi or their materials. And I really got this from Malcolm Campbell, who was at Davidson College in North Carolina, when I was a postdoc, this is going back 14 years or so. And Malcolm told me once on the phone, he said, “Find someone who you consider to be a master teacher, and go watch him teach.” But he said “don’t go just once, go a lot. Once a week, if you can for several weeks, and you’ll get to see them handle different situations, you get to see the ups and downs of the semester, you get to see what it’s like on the day where the midterm gets passed back. Or you get to see what it’s like when they’re getting to a really difficult topic or there’s some kind of disruption that class and how they handle it.” That’s the one great thing about peer observation is that if I go to your classes, sure, I’ll be able to give you some comments or feedback on what I saw, but I’m going to learn probably more from seeing you two teach than whatever I could give you and then I’m able to incorporate that into some of my lessons and my teaching style. If we can just change that culture, make it a little bit more okay sometimes to talk about teaching, share teaching strategies, see each other teach and have fun with it really and learn from each other, I think that can go a long ways towards, again, improving student outcomes and helping them do better in all aspects of college and life.

Rebecca: I found one of the most fun opportunities for observations is doing observations outside of your own discipline. It’s really informative to see how people in wildly different disciplines approach teaching and the way that they operate their classroom. I remember visiting a dance instruction classroom when I was at Marymount, at my prior institution, and it was really interesting, it was fascinating to me about how specific and transparent every little move was and how to correct things and the anatomy that was being discussed and just the level of depth that you might not realize how something transpires in a classroom unless you’ve actually had the opportunity to observe it.

Justin: I’m going to play that some for my faculty Rebecca. I thank you, because that’s what we’re trying to do at Mines is not intra-departmental, but rather inter-departmental observation. So getting across the disciplines for sure. Because yeah, you learn so many different things. And even if you’re just going from mechanical to electrical engineering, there’s still a lot of differences between those types of courses, you might see what’s going on. And I’ve learned that myself, I’ve watched some economics instructors teach at Mines, no idea. I feel like I maybe should know this stuff to be a better financially literate person myself, but I learned so many cool ways about how they’re teaching, but I also learned some cool concepts.

John: We do have an open classroom project here on our campus, we keep hoping more people will open their classes and more people will attend. But the people who have participated have found it universally to be valuable. So we’re going to keep doing it, and we just hope to see it become more a part of the culture.

Rebecca: Sometimes just indicating to a faculty member that you’re interested in their content, and you just want to sit in because you’re curious is a great way to learn new content, and maybe get an opportunity to observe someone teaching. [LAUGHTER]

Justin: And yeah, I definitely pitch it that way. Like I want to learn from you. And you get some new ideas. And I feel like in that case, faculty are more than willing to have you in. Well, yeah, Best of luck with that open classroom project. I’ve seen those types of programs in the country kind of sometimes hit sometimes miss. But best of luck with that.

John: One of the things you’ve done is just some research or some experiments involving two-stage exams. Could you talk a little bit about how you implement them, and what you found in general? And how did students react to the two-stage exams?

Justin: Yes, so I’ll try to be brief on these because I could spend probably 45 minutes on these myself. But yeah, two-stage collaborative exams, or more affectionately called group quizzes or group exams for short. There’s been a ton of literature on this Jim Cook, UC San Diego, he really helped me get started in this about five years or so now. But it’s all disciplines. You look it up, and the one paper I have, you mentioned in the intro, there’s a lot of references to different STEM disciplines that use them and some non-STEM too. The idea, though, is that we push active learning, we push group work, we push collaboration, but then we assess you by yourself with a pencil and paper and a calculator on a piece of paper, so why not change the dynamic there a little bit. And the two-stage idea is that first you have students take an individual quiz or individual exam, and I personally have gone to a weekly quiz model with my high-structure courses. I don’t do midterms anymore, I don’t do finals sometimes even. I know that’s taboo sometimes, but it depends on the class and I might not even do that. My colleague in Irvine Adrienne Williams says with high structure by going to the weekly quiz model, instead of having these giant peaks of anxiety with the two or three midterms, we just have a smooth level of anxiety the entire semester, and spread it out a little bit. But, for me, group quizzes then, what they look like is students take the individual quiz, turn it in, then they get in a group, this is a predetermined group, they know who their group is going to be. And then I give them a group quiz. That group quiz in the paper that you referenced was an identical one. So they took the identical two problems. And this was a MEB material energy balance class. So it was just two numerical problems, problem solving. They did that again as a group. However, my other courses now I do a different quiz. It’s either an isomorphic question, so slightly similar, but a little bit different, maybe in intro thermo or if it’s biology or anatomy and physiology, completely different set of questions. Then they do it as a group. The reason we do this, again, was trying to get this collaborative piece in the group setting. But also, when do you find students are most excited to talk about a quiz or an exam? It’s as soon as it’s over, they go walk out, the hallways abuzz, everyone’s all excited, good or bad excited, but they’re talking. So let’s capture that energy and do it in the classroom through that group assignment. Now, the group quiz is usually a fraction of the weight. In the literature, you’ll see, it’s usually let’s say you call the whole experience 100%, the individual quiz, maybe 80%, the group quiz is 20%. But that can vary from 75 up to 95, however you want to do it. And again, they’re covering the same kind of concepts just in that group dynamic. And so when I did this the first time, I got some consultations from my co-instructors, Rachel Morrish, Dave Marr at Mines, and I was a little bit nervous to see how it would go. But it was a hit. It was an absolute blast. The energy in the room is one thing I cannot describe it strongly enough here through audio, it’s just you got to see it. The students are energized, they’re talking, they’re debating. They’re working through the problems together. They’re trying to figure out, I will use the F word here. It is fun. It is a very fun experience to see. I’ve had students tell me that after the quiz is over, like that was a lot of fun. Talking about spreading things on campus. This is one thing that has spread a little bit at least within my department of chemical engineering, a few other classes have been using them now. And I collected some data on this, which I published, showing that… which makes sense, there was no shock… but the group quiz score is higher than the individual score because you’re tackling this together right away. And then also though, students strongly preferred it. The affect, the positive attitude response was through the roof. Both of those results, these are replicated from other disciplines, they see the same kind of things. I think it’s a really nice way to promote that community in the class, show that you’re working together, add that active part to the assessment. However, I’ll end with saying there can be some resistance to this, especially from students who might feel like “hey, I can do it all on my own, I’m fine.” And then they have to work together with maybe some students, they don’t know as well. You might get some resistance from students saying that I don’t want to work with someone else, I wanted this on my own. So be prepared for that. Also, accommodations with testing, if you have students who get extra time, that can be difficult to manage. I will say though, from doing this now about five years and four different classes at Mines, I’ve never had a single issue with students and extra time. What I typically do is I’ll have students get the extra time for the individual part, then they come join us for the group part and have the normal amount of time because in that group setting the students with extra time, they’ve always told me and I always ask them, I say, “are you okay with this?” And they’re like, “Yeah, it’s fine to have the normal time because I’m in a group.” So just some things to be aware of, if you’re going to try them out. And again, I could go on and on with these, so if anyone wants to learn more, hit me up. I’m happy to chat with ya.

Rebecca: Sounds like a good day to visit a classroom, huh?

Justin: It’s an energetic day for sure. Although you might not see much teaching going on if it’s just the assessment part. But it’s fun to drop in and see what’s happening.

John: There is a lot of teaching going on in their second stage, though.

Justin: Absolutely.

John: In fact, when I first did it, I was so excited about it, I made a short video recording and sent it to Rebecca, so she could see the dynamics of that interaction.

Rebecca: And hear it.

John: It was just really, really different than going over a quiz, where some of them would be really happy, but not that focused. And the students who did poorly were generally pretty disengaged when we went over a quiz ift they didn’t do so well. But when they were explaining it to each other, it was so much more positive.

Justin: Yeah. And you’re right, the teaching is happening. It’s coming from the students to each other. Not for me necessarily, but it’s coming from them. And it’s so powerful to see… absolutely to hear that live.

Rebecca: But you’ve set up the structure to facilitate it. So therefore, you’ve done the teaching.

Justin: [LAUGHTER] Thank you. Yeah.

Rebecca: So we always wrap up by asking: “what’s next?”

Justin: Yeah. So for me, what’s next? You mentioned at the top, John, I have this new position, I’m Associate Dean of Undergraduate Studies. And I mentioned in passing, I have a side business I called Recombinant Education. I do workshops for faculty. I’m writing a book. For me, I don’t know what happened, but last year, I had a birthday the ends in zero. Things have been a little wonky in my brain lately. And I listened to Taylor Swift now, sometimes. I never used to, but I think a lot of people do that. So it’s not just me turning that age. But the point being is that I’ve been doing this enough time now that I feel like I have things to share. And I’m trying to do more of that. So I’m trying to, and I’m still nervous to do things like this kind of stick my neck out and even talk to folks like yourselves, but I want to share best practices with teaching and learning, specifically with STEM education, because I still hear from students and I still see it from time to time, students are just not getting the best classroom experience they should be getting. College keeps getting more and more expensive. Students don’t deserve to have less than excellent experiences, in my opinion. I’m doing what I can on my own to share these best practices. Someone called me a one man teaching and learning center, it’s probably a fair way to say it. One of my students said, “Oh, you’re teaching teachers how to teach,” and that’s, I guess, another fair way to say it. But again, I got the energy for it now. I kinda have this midlife crisis going on too where I want to make some bigger impacts on the world outside of my own bubble, whether it’s at the administrative level at Mines now or across the country, or even the world. So I love working with other faculty on all these different areas. And that’s what I’m trying to make a big part of my day-to-day life now. But I’m still in the trenches. I’m still teaching classes every semester, because that really keeps me rooted, lets me try some new things out, still doing the DBER work and the SOTL work, working with students and just trying to have a blast and do what I can here in the time I have left.

John: Well, thank you for joining us. And we’re really looking forward to that book. And I hope you’ll come back and talk to us again when the book is close to coming out. Or sooner.

Justin: I would be honored to come back anytime John and Rebecca and if both of you are ever in the Denver golden area, please let me know. I’d be happy to show you around out here.

Rebecca: Well, thank you so much for joining us. It was fun to talk to you and to hear about the fun happening in your class.

John: More F words.

Rebecca: Yeah, [LAUGHTER] a lot of F words.

Justin: Yes. [LAUGHTER] Thank you both. I appreciate it. It was fun.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

GANESH: Editing assistance by Ganesh.

[MUSIC]

329. Admission to Highly Selective Colleges

Graduates from a small number of elite private colleges account for a disproportionate share of America’s business and political leaders. In this episode, John Friedman joins us to discuss his recent study with Raj Chetty and David Deming that examines how admissions criteria at these institutions privilege students from high-income families.

John is the Briger Family Distinguished Professor of Economics and International Public Affairs at Brown University, where he is the chair of the Economics Department. He is a Research Associate at the National Bureau of Economic Research and has served in the White House as Special Assistant to the President for Economic Policy at the National Economic Council. John is also a member of the U.S. Treasury Council on Racial Equity, a co-Editor of the American Economic Review, and a founding Co-Director of Opportunity Insights.

Show Notes

Transcript

John K: Graduates from a small number of elite private colleges account for a disproportionate share of America’s business and political leaders. In this episode, we discuss a recent study that looks at how admissions criteria at these institutions privilege students from high-income families.

[MUSIC]

John K: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by

John K:, an economist…

John K: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John K: Our guest today is John Friedman. John is the Briger Family Distinguished Professor of Economics and International Public Affairs at Brown University, where he is the chair of the Economics Department. He is a Research Associate at the National Bureau of Economic Research and has served in the White House as Special Assistant to the President for Economic Policy at the National Economic Council. John is also a member of the U.S. Treasury Council on Racial Equity, a co-Editor of the American Economic Review, and a founding Co-Director of Opportunity Insights. Welcome.

John F: Thank you so much for having me. It’s a pleasure to be with you.

Rebecca: Today’s teas are: … John, are you drinking any tea with us today?

John F: So, I’m a big tea drinker…

Rebecca: Yay!

John F: …but, I drink tea in the morning. And so I had a delightful Hunan tea this morning, which I will draw on the reserves of that energy throughout this conversation.

Rebecca: Well played. [LAUGHTER]

John K: And I am drinking a ginger peach black tea from the Republic of Tea. Not so fancy, but I enjoy it.

Rebecca: I have an Awake tea because I also need some energy. [LAUGHTER]

John K: We’ve invited you here today to discuss your 2023 working paper with Raj Chetty and David Deming, “Diversifying Societies leaders: The Determinants and Causal Effects of Admission to Highly Selective Private Colleges.” This paper created a big stir in higher ed and other circles as well. You note in this study that less than one half of 1% of college students attend Ivy plus institutions. While most of our listeners will be familiar with Ivy League colleges, what are the other colleges that are included in the Ivy plus designation?

John F: Thanks. And it’s helpful to clarify up front, the colleges that we’re directly studying are the eight Ivy League schools: Harvard, Yale, Princeton, Dartmouth, Brown, Columbia, Princeton, Penn, and four close peers which are Stanford, MIT, Duke, and Chicago. The important thing to know here, you’re right, that there’s a pretty small share of students, it’s not that something changes discreetly, when you move out of that group of 12 schools, and you go to another outstanding private institution like Northwestern or Johns Hopkins or something like that. We have some data, it seems like there’s some pretty similar things going on across a lot of these very highly selective private institutions. Where you do see things being quite different, where we have some data as well, is at the most elective public institutions, places like UC-Berkeley, University of Michigan, UT-Austin, places like that.

John K: You still have to draw the line somewhere when you have prestigious institutions.

John F: That’s right.

Rebecca: So you noted that these institutions enroll a small share of our students, why are they so important? Why do we need to study them?

John F: That’s right, less than 1% of college students in the country go to one of these schools. And, of course, college students themselves are just a small share of students born in any given cohort. What we found, though, was that students from these institutions are really highly over represented in leadership positions in society. You see that if you look at who’s at the top of the income distribution, or who’s a CEO of a Fortune 500 company. More than 10% of those individuals are from these Ivy plus institutions. But it even gets higher when you look at who’s in the U.S. Senate. About three-quarters of the Supreme Court justices over the past 50 years have come from the schools. And so for sure, the schools themselves are not going to be making broad scale changes in upward mobility in our society. They’re just too small. But in terms of creating both a diverse group of leaders and a broad set of pathways, where children from any background have the chance to be a Senator or Supreme Court Justice, whatever, these schools are incredibly important.

John K: One of the things that your study did is it investigated questions that couldn’t be investigated before because of the data that you were able to assemble. Could you tell us a little bit about the data set that you use?

John F: Sure, our study, like so many others, has been the beneficiary of the big data revolution. It’s affected so many aspects of society, and this is the academic part of it. We’re merging together datasets from three different places. The starting point for this paper and for many of my other research is the universe of U.S. tax and census records, which have been merged together at the US Census Bureau. And what that allows us to do is to identify individuals when they’re kids and then actually follow them through to not just project what we think their outcomes might be, but really actually observe them after they get out of college and they’ve entered the labor force. Those data are incredibly important in terms of measuring upward mobility directly. Then, on top of that, in order to study really in depth what’s going on at these institutions, we have internal admissions data from several Ivy plus colleges as well as a bunch of these most selective public universities and university systems. And we see where children are coming from, or where they grew up in the tax data, we see where they end up in the tax data, the college data are really filling in this in between, how do they go through the college application process. We both learn a lot of other information about them, like where they applied, there’s a lot of detail about the evaluations of their applications, as well as of course, whether they eventually get in and matriculate. The final data that we’re using is a set of standardized test scores from the two main testing companies: College Board that runs the SAT, and then ACT, which runs the eponymous test. And the way we use those data are to start from a baseline of academic achievement at the point when these students are applying to university. And we can talk about how that works, and of course, it’s not a perfect proxy for where students are. But when we think about the role that universities are going to be able to play, we just have to be realistic about the fact that they are starting to interact with students when they’re 17 or 18, and there’s a whole lot of inequality in our country that’s going to affect students long before that. And so we talk, of course, as a policy matter about how to deal with all that inequality. But the reality of the situation, especially at this highly selective level, there are going to be some students that just aren’t academically prepared. So that’s going to shape the set of students that these colleges can recruit or admit.

Rebecca: One of the main questions that you address in the paper is: “Do highly selective colleges amplify the persistence of privilege across generations by taking students from high income families and helping them obtain high-status. high-paying, leadership positions?” What do your results suggest?

John F: So that’s exactly the kind of broad goal of our paper, to answer that question. And I think, unfortunately, the answer is that on average, yes, they do amplify the persistence of privilege. That comes from two different parts. So first of all, the students who attend these colleges, we measure a pretty large causal effect on their outcomes, specifically in these leadership positions as adults. Of course, the students are very highly selected when they come in. And so even if the college’s weren’t doing anything, you’d expect these set of students to be doing some impressive things afterwards. But what we find when we talk about more of the details of how we do this later, there’s a very large causal effect. And so these universities, it’s not just that a large share of senators come from them, they do seem to be a very important pipeline effect, where it’s really propelling students up into these leadership positions. Now, on the admission side, who are the students that are coming into this set of institutions that are benefiting from this really positive effect? The problem here is that even relative to the distribution of test scores for high school graduating seniors, which as we talked about before, exhibit a whole amount of inequality due to differences in education and neighborhoods that different students from different backgrounds have been exposed to before they’re applying to college. Even just looking at students that have the very same test scores, high-income students are substantially more likely to be admitted to and attend these institutions, relative to lower-income students, and especially middle-income students. The gaps are largest when comparing students from very high-income families to students from middle-class, upper-middle class families.

John K: And in your study, you tie some of this selection process to athletic scholarships, to legacy students, as well as attendance at private high schools. Could you talk a little bit about how those factors influenced the decisions?

John F: Sure. So the approach that we take is a decomposition of this pipeline, we see that students are coming in with, let’s just say everybody has the same test score, a group of students at the beginning, we see that the students from high-income families are more likely to end up attending this set of schools at the end of the day, and we’re going to try to decompose where in the pipeline these disparities are emerging. And so the way we first start is actually at a somewhat higher level than you asked the question, which is just to decompose these differences between the application phase, which of the set of students with a given test score applies to these institutions, the admissions phase of those students with that given set of test scores that applied which are admitted, and then the matriculation or the yield phase of those that are admitted whose actually going to choose to come at the end of the day? And what I found interesting coming into this project is that there are many different analyses or ideas about how each of those three phases could be affecting it. There’s concerns about who has the information or the resources to apply. There’s concerns about potential biases in the admissions process from some of the factors that you mentioned, legacy preferences or private schools. And there’s a concern that maybe schools aren’t offering financial aid that’s sufficient in order for students from less affluent families to attend. In our data, we see that about two-thirds of that entire disparity is coming from the admissions part of that alone. So that’s not all of it. But I mean, just to give some numbers, there are about 250 students from the top 1% of the parental income distribution who are in an average starting first-year class, that’s about 1650 students. So right there, about 15% of the class is coming from the top 1% of families. Of those 250, we find that about 160 of them are extra in the sense that if everyone attended at the same rate, when they have the same test score, there would only be about 90 students from the top 1% of families. And so then of that 160, about 100 are coming from the fact that high-income students are more likely to be admitted. There are smaller effects coming from differences in application rates, even smaller effects coming from differences in matriculation rates. But primarily, the differences are coming through the admissions process. And even before we get into specific policies, I think that that decomposition is incredibly important, because the admissions process is the one part of this that schools entirely control themselves. If you want more people to apply to your school, that’s hard, because applications are the students’ decision, you have to go out and convince a bunch of students to apply. If you want to get more students to yield, to matriculate, you have to convince those students, it’s their decision. The choice about who to admit, it’s just the school’s choice. This is the one lever that the schools entirely control. And so the fact that most of the disparities are explained by this set of policies, on the one hand, maybe that’s a good thing that they control, and maybe can directly fix what is the source of the problem. On the other hand, it’s a little bit discouraging that it’s in the choice of these own universities that these disparities are being created, despite what are typically loudly voiced concerns for upward mobility. So it’s really the admissions process that matters. Now, we then go down to the next level. and this gets to the factors that you mentioned. Why is it that a high-income student with a 1400 test score is going to be admitted at a higher rate than a middle-income student or a low-income student with a 1400 test score. And even just to start with, in some sense, the dog that didn’t bark here, you might have thought that students with a 1400 from low-income families, they might even be more impressive that they got to that level despite facing all of these barriers, but we see that admissions rates are in fact much higher for high-income students. And we trace that back to three factors. The first and most important factor up 40% of what’s going on is the preference for legacy students. Those are students who are children of alumni of the institution. Now, legacy students affect the admissions rate of high-income individuals for two reasons. One is pretty obvious, the alumni of these institutions themselves are just much more likely to be high income. That’s kind of the generation before, we’re getting the same positive effect of attendance. But the second reason, I think, was a little bit more surprising to me. It turns out that legacy students from high-income families receive a substantially larger admissions boost, even then, legacies from lower-income families. So there’s kind of a preference for high-income students, even within the legacy pool. And you put those two things together, and that accounts for about 40% of the admissions difference. The second factor is the fact that all of these schools designate about somewhere between 12 and 15% of their class for athletic recruits. Now, there’s nothing inherent in athletics, that means that it has to be students from high-income families. And in fact, if you look at the distribution of athletic recruits at public universities, those students mirror the income distribution of most of the other students at the school, in the sense that there’s not a tilt towards high-income families. But at private institutions, the share of admitted students that are athletic recruits among high-income families is significantly higher… more like 13-14%… than It is among admitted students from low-income families where only 5 or 6% of those students are athletes. Now, why is this the case? I was an athlete in college myself, and I don’t think that it’s just because kids from higher-income families are more athletically talented. I think it has to do first with the resources that are available to these kids. Becoming a college baseball player isn’t just about having good hand-eye coordination, it’s about being able to attend clinics, being part of a travel team, there’s like a lot of stuff that goes along with being able to get to that level. And then I think the second factor is that the set of sports that are offered by many of these institutions go well beyond the canonical football, basketball, baseball, which may be a little bit more broad base, but they also include sports like water polo, or sailing or equestrian. And these are sports where I’m sure that there are examples of athletes from all across the income distribution, but think they tend to skew towards more high-income families. So athletic recruits are the second major chunk. And then the third is what my friend David Leonhardt at the New York Times likes to call private school polish. A lot of what the schools focus on in the admissions process goes beyond just how academically prepared people are, and they really like to see somebody who’s doing interesting things that could be as part of extracurriculars, that could be the way they spend their summer, could be the way that teachers write about the students or the guidance counselors write about the students. And all of this gets channeled through a student’s evaluation on non-academic factors. And what we see there is that not only are students from high-income families much more likely to get very strong non-academic ratings, that seems to flow through through things like recommendation letters that are really centered at the school level. And just more generally, you find if you compare high- and low-income students who are attending the same school, you no longer see this disparity in non academic ratings. And so our sense is that these other broader factors that kind of seep into the admissions process are accounting for the third leg of this tripod that’s giving high-income students an advantage in the admissions process.

John K: And some parents are probably sending their students to more elite private schools in the hope that that will enhance their prospects. And the schools that accept them recognize that one of the reasons students are going there is because they prepare them better for selection in a more prestigious institution.

John F: I think that’s exactly right. I think it’s not just parents and schools, the thought that colleges place a substantial weight on these non-academic factors, which then can be kind of trained for and developed over the years, I think this is really a major force that shapes the way that parents and kids and lots of organizations in society direct their resources. So let me just give you an example here. I was presenting this paper at UC Berkeley in the economics department and a friend of mine who lives in San Francisco, who’s a professor there sent me a picture of an advertisement on the side of the road, like kind of billboard on the side of the road, for a fencing academy. It’s called the Saber School. And it says “a safe, fun sport that will help: what are the things that doing saber will help?” Well, number one, it will enhance performance at work and school. Okay, that sounds plausible. Number two, it will enhance speed, coordination, and decisiveness. Number three, it will help you get accepted at top US colleges, just like right there on the billboard. And so if you want to fence as a kid, that’s totally fine, and some people are gonna really enjoy it. But the fact that colleges value this and so now all sorts of people are spending their time fencing simply because they think it will help their college application, I find that to be a little bit silly.

Rebecca: I don’t think we would have found that billboard in my neighborhood. [LAUGHTER]

John K: Although if you brought a saber to work, [LAUGHTER] you might get more attention.

John F: That raises a host of other issues. [LAUGHTER]

Rebecca: In your study, you also examined admission rates at highly selective public colleges. Do their admissions also favor students from high-income households over lowincome households when other student characteristics are held constant?

John F: Yeah, so the public most selective institutions, they provide a really interesting contrast to the private schools, and there are really two differences. The first difference is that it’s still true that students from high-income families with the same test score are more likely to be attending these places like UC Berkeley or Michigan than students from lower-income families. But it’s not the super concentration in the top 1%, the top 1% are about 20% more likely to attend, but so are the top 5% And roughly top 10%. It’s more kind of a broad top of the income distribution than kid of the uber rich that are benefiting from this. Then second, when you do the decomposition that we do at the private schools, you find that, in fact, it’s not the admissions process, the chances of admission for students with a given test score are almost identical across the income distribution, if anything slightly higher for lower-income students. The big differences come in the fraction of students who apply to these schools. You see almost all of the over attendance is explained by higher application rates of high-income students. And so that really points to a very different part of pipeline. And I think there’s a whole other set of issues that in kind of policy concerns that that brings up, just to cite some fantastic work in this space by my colleague at Harvard, Sue Dynarski, she and a number of co-authors have worked with the University of Michigan over the past 10 years, on something called the Hail scholarship. And this program is really focused on this application phase where they reach out to students who are doing very well in Michigan Public Schools, and who are not from high-income families. And they not just inform the students about the University of Michigan, but they provide a simplified form of financial aid, that’s a tiny bit more generous, but just mostly clearer, that’s basically guaranteed zero for four years. And that seems to have really large effects, big increases in the share of students who are applying who receive these types of fliers, that then carries through to those that are admitted and those that end up matriculating. And so, first of all, it’s really interesting that there are sometimes different problems at these different schools. But also, I think it’s a nice lesson that even among two different schools, which are objectively at the very top of the U.S. higher educational sector, there are really important differences in terms of how these different institutions operate, and what types of policies are going to be most appropriate for increasing diversity of students and social mobility at those places.

John K: Is the rate of return to education significantly different between the Ivy plus institutions and elite public institutions?

John F: The answer is yes. But it’s different in a very particular way. So in our data, what we find, using a bunch of different empirical approaches, is that students that attend these Ivy plus institutions are significantly more likely to be at the very top of the income distribution to attend an elite graduate school, to hold a very prestigious job. They’re much more likely to do that than students who attend the very most selective of the public institutions. Those public institutions, in turn, are significantly better at propelling students to these leadership positions than lower rated less selective public institutions. And so it is both true that those public institutions are very good, and also true that these Ivy plus schools are really quite a bit better. That’s focusing on these top end leadership positions. If you look instead at something like what’s the chance that you’ll be in the top 20% of the income distribution, so for kids in their early 30s, that’s earning more than about $60,000. So that’s a good solid, professional job, you don’t have to be a hedge fund manager, there, attending these Ivy plus schools is not really going to make that much of a difference. And the reason is that at that point in the income distribution, that’s just not what the schools are designed for. You’re quite likely to get a job that’s going to pay more than that from an Ivy League school, you’re also quite likely to get a job that pays more from that at one of these elite public institutions. There are differences in average income, but it’s really driven by this kind of a lottery ticket that you’re getting on maybe you’re going to be really just an extreme leader, again, either very top of the income distribution, very prestigious firm. So the answer is yes, these schools differ, but they primarily differ in this particular way, which is why we’ve placed the emphasis on leadership rather than just kind of broad economic security. It’s not clear that students from Ivy plus schools are just broadly more economically secure in that middle of the income distribution than those from public schools.

John K: You also examine in this paper what would be the effects if the admission process at the more elite institutions were similar to that at highly selective public institutions? What do you find there in terms of the income diversity of students in the Ivy plus institutions if those preferences were eliminated?

John F: Yeah. So we’re able to simulate, exactly as you say, what would these classes look like at least probabilistically, if the admissions office were to place less weight on some of these factors, and it makes a meaningful difference. So just to give you one statistic, currently, on average, there are a bit less than 60% of students at these schools that come from the bottom 95% of the income distribution. Those are families making less than call it $250,000 A year. If you were to get rid of all these three preferences that I’ve talked about, if you were to remove preferences for legacy students, just to be clear on what that means, we’re just going to admit them based on all the other characteristics, oftentimes they’re great students, but we’re just not going to give them an extra boost for being a legacy student. If we were to remove this seeming bias that arises in the process where higher-income students are getting stronger non-academic ratings, and if you were to not necessarily remove athletics, but just make the athletes look like all the other students, so there’s not this tilt towards high-income students among athletes, you would increase the share of students from the bottom 95%, from a bit less than 60 up to about 70%, a bit less than 70. And so what does that mean in practice, again, there are about 1600, 1650 students in the average entering first-year class, we’re talking about another 150 to 160 students from more modest backgrounds. And, of course, this is not an enormous change. But it’s on the same order, as people are talking about when we think about what’s the difference in student bodies that might come from changes in racial preferences in admissions flowing from the Supreme Court decision. It’s on a similar magnitude. We’re gonna have 100, maybe 150, fewer students of color on campus. And I think it not only affects the diversity on campus, I think it also meaningfully affects the role that these schools are playing in upward mobility, particularly to these leadership positions. You make some admittedly heroic assumptions and kind of flow things through, this type of change is going to make another two or three US senators from the middle class instead of from very high-income backgrounds. And let’s not overstate this, like it’s only two or three senators, but for a set of decisions that literally 12 People can decide to make if they want to. I think that’s pretty impressive. And that doesn’t even think about well, what if the Northwesterns and the NYUs of the world decided to make some of these changes as well. So my sense is that we’re not going to remake society by doing this, but it’s a pretty low-hanging fruit. And the thing to say is it just from a policy perspective, you can achieve the same differences in the admissions pool, either by getting rid of the preferences that are afforded to high-income students, or by introducing new preferences that benefit students from low- and middle-income families that are particularly academically strong. And what we show in the paper, we kind of calibrated, we say like, if you were to introduce a new preference, specifically designed to get exactly the same mix of students that you would get from eliminating these preferences, what you would need is a preference for low- and middle-income students that’s is weaker than the preference even that current admissions offices put in place for legacy students. So legacy students, on average, are about three or four times more likely to be admitted, you’d need really strong academic students from low- and middle-income backgrounds to be, on average, about twice as likely to be admitted. And that would be a big change. But it’s not like these are changes that go well beyond the type of preferences that are already in place in the admissions process,

Rebecca: …and seemingly pretty actionable. [LAUGHTER]

John F: Yeah, and look, I think that this is a particular moment of fluidity in higher education admissions. Because of the Supreme Court decision, people are not just reconsidering how to think about diversity. That’s kind of the direct effect. But once you open up the gearbox, I think it then becomes natural to rethink a lot of different things when it comes to admissions, both because once there’s a process, it’s easier to think about other stuff. And also because I think that having a preference for students from overwhelmingly high-income families becomes increasingly awkward when you’re no longer allowed to give preferences for students who are clearly experiencing very large disparities in the run up to college. So I think almost all colleges are really strongly considering a bunch of this stuff. Some of them are doing so in publicly announced committees. Here at Brown University, I serve on a committee, including both faculty and trustees that are thinking about a bunch of these issues. Other universities are doing it more internally, only trustees, maybe it includes students. All the universities are doing this in a different set of ways. And I wouldn’t be surprised if we see more change in the way college admissions works over the next year or two than we’ve seen in a long time. And so yeah, hard to know what will happen, but these are an incredibly important set of issues to consider and I hope we’ve been able to contribute to that debate. As an academic, all you can ask for is that people will listen, policies, it’s up to them. There’s a lot of factors that go into that go beyond the research. But we’ve been really, both in public and had a lot of conversations with university leaders about how to think about these issues. So whatever the decision is, I’m confident it will be made on the basis of what I hope is a better set of analyses and understanding for what’s going on than we had before.

John K: Before, I think everyone expected that these types of results were occurring, but I don’t think it was really clear how large the magnitude was. And your study certainly contributes to that knowledge. Having data like this, and these results, I think, will put more pressure on institutions to change than just the general suspicion that they were privileging a very elite group of students. One of the things you note in the study is that making these changes will lead to a more diverse leadership pool, but it may not have as much of an effect on intergenerational income mobility. Could you talk a little bit about that?

John F: That’s exactly right. And I think that stems from some of the themes we’ve been talking about, where the role that these schools play in intergenerational mobility to leadership positions, that’s potentially very large. But they’re just too small to play a role in addressing some of the very broad differences in equality of opportunity that we see in this country, other than through kind of the indirect channel, which is that I think when you have individuals in these leadership positions that come from a broader range of backgrounds, you’re more likely to get policy that’s made in a way that takes into account some of these effects. And so that actually leads to some of the research that we’re really now focusing on, which is that, when you think about intergenerational mobility and higher education, an initial paper that I wrote on this, decomposed the problem into what we called access, that’s who’s attending and the success, what happens to the students that attend, you need both of them to be working together to have intergenerational mobility. If either of them is absent, then you have less mobility. And what we found was that different types of institutions seem to have problems in different areas. So institutions that were highly selective, not only the Ivy plus institutions, but honestly also some of the public institutions in the country, their lack of effect on mobility, in large part, was coming from the relatively un-diverse set of students on an income dimension that were attending their school. Many of these schools, again, both public and private, the share of students come from the bottom 20% of the income distribution is really just 3 or 4%. Really not large at all. So we really wanted to separate the question for these institutions of how do you improve mobility through increasing access with the situation for what is a very different set of institutions, not just the elite public institutions, but some of the open-access institutions, the community colleges where there, not that access can’t be improved, but I think much more the problem is that, in many cases, students are attending these institutions and not being propelled upwards in the income distribution in the way that we would hope. And so that’s really now what we’re focusing on: How can we first measure, in a very broad way, what these different institutions and programs are doing in order to propel students up the income ladder, to really give them the skills, the human capital, the social capital, in order to get good paying jobs and move upwards after that in their career? And then what are the policy levers that you would pull in order to improve that? The way I like to think about this is suppose that you gave the governor of California $10 billion to improve upward mobility in education in his state. Would you want to get more people going to Cal State instead of the California Community Colleges? Is it important that you not only go to all Cal State, is it important that you go to a particular Cal State? Is it important that you have a particular program? Are some programs much more effective than others? Should we be encouraging more people to go to community colleges, even if that costs and has fewer people going to Cal State? Do we want more people to start at community colleges and transfer up to Cal State? Do we want more people to not start at community colleges, because it’s better if you start directly at Cal State? There’s all these different questions. And there’s been some great research on different aspects of it, but I think with the data that we have, we’re hoping to provide a more unifying framework to think about what are the particular places where there’s more or less success for students, again, defined as like the causal effect of attending these places. And how can we expose more students to high success environments, either by moving them around or by changing what the programs are?

John K: In your intro, we mentioned that you were a member of the U.S. Treasury Council on Racial Equity, and the Co-Director of Opportunity Insights. Could you talk a little bit about what these organizations do?

John F: So Opportunity Insights is a research and policy organization that I run jointly with my co-authors Nathan Hendren and Raj Chetty. And what we’re doing there is trying to put together a research agenda to understand upward mobility, both from an academic and a policy perspective. Research that involves this kind of big data has evolved over the last decades to almost look more like a science lab where it’s very team oriented. It’s not a professor and her keyboard or chalkboard just kind of plugging away in isolation anymore. And Opportunity Insights is a way for us to organize all of that team in terms of there are other faculty that we collaborate with, there are graduate students we collaborate with, there are research assistants we collaborate with, there are visitors at all different levels that we collaborate with. And so Opportunity Insights is really the organization through which we just do a lot of this research and try to translate it to help policymakers and whatever that means, depending on the research. The Treasury Advisory Council on Racial Equity is very, very different. Treasury is one of the largest agencies in the federal government. And it has many different policies that directly or indirectly affect racial equity in ways that are obvious or not obvious. And the purpose of this Advisory Council is to bring together people from many different aspects of society that are relevant to Treasury’s financial policymaking. So there are a couple of academics on the committee like me, but there are also people who run financial institutions, there are people who run nonprofits that deal with financial institutions, people who run non-financial institutions, more businesses. And the idea is to be a group that can both proactively offer suggestions to Treasury in terms of how they can change things either out of blue sky or on particular policies that are undergoing after policymaking, as well as a resource for them to turn to when they say look like we’re trying to figure out… an example is a lot of the focus of Treasury over the last two years has been the implementation of the IRA bill, which includes a lot of tax incentives for green investment. How can they implement all of those tax credits? How can they write all those regulations in a way that really does so to support racial equity, and to make sure that black and Hispanic and native individuals are not left behind in a way that, unfortunately, has been too often the case in our nation’s history. So that’s far from a full-time role. We meet once a quarter in public meetings and try to offer our suggestions. And even again, this suggestions span how Treasury should implement different regulations from even how Treasury can make research on racial equity more accessible, or make data more accessible to support more research so that there’s more broad knowledge when it comes time for policymaking.

Rebecca: You’re doing some really exciting and interesting things.

John F: Thank you.

Rebecca: Thanks so much for your work and sharing it with us today. But we always wrap up by asking: “What’s next?”

John F: So I talked about some of the work in the college space. But I’m trying to think about other parts of upward mobility as well, to understand how environments or policies contribute to these disparities or what policies can help alleviate them. And a big theme in some of my recent work is to try to broaden our measure of mobility to go beyond these purely economic measures. It’s a natural place to start, both because having a higher income is something that is kind of meaningfully related to the quality of one’s life and also because it’s pretty consistent data to measure income. But I think even economists will admit to you that income is not the end of it. And we’re trying to think about other ways, not only to measure people’s wellbeing thinking about health, thinking about social capital, for instance, but also to measure or folks influence on broader society. So there are positions like entrepreneurs or scientists, inventors, that if we generate more innovation in society, that’s not something that just benefits the individual inventor, it’s something that benefits society much more broadly. And so I think that’s not only very important as kind of an alternative economic outcome, but it’s important to thinking about why something like social mobility goes beyond merely thinking about well, each individual should have their fair chance of success. These are ways in which just society as a whole is better, more innovative, more engaged, when there’s more upward mobility. And in that way, I think it’s really a rising tide that can lift all boats. So that’s a little bit of what I’ve been thinking about recently.

John K: Well, thank you for taking the time to join us. We really enjoyed this conversation. And we really, as Rebecca said, appreciate all the work that you’ve been doing.

John F: Thank you so much. It’s really been a pleasure to talk with you about all this work over the last hour and I appreciate that.

[MUSIC]

John K: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

327. Attacks on Education

In the last few years, a growing number of state and local governments have attempted to limit diversity, equity, and inclusion initiatives and to place restrictions on what students are allowed to learn. In this episode, Kevin Gannon and Cyndi Kernahan join us to discuss strategies that can be used to resist these attacks on education.

Kevin is a history professor and the Director of the Center for the Advancement of Faculty Excellence at Queen’s University of Charlotte. He is the author of Radical Hope: a Teaching Manifesto, which is available from West Virginia University Press. Kevin also appeared in 13th, the Netflix documentary on the 13th amendment. Cyndi is a Psychology Professor and the Director of the Center for Excellence in Teaching and Learning at the University of Wisconsin at River Falls. She is also the author of Teaching about Race and Racism in the College Classroom: Notes from a White Professor.

Show Notes

Transcript

John: In the last few years, a growing number of state and local governments have attempted to limit diversity, equity, and inclusion initiatives and to place restrictions on what students are allowed to learn. In this episode, we discuss strategies that can be used to resist these attacks on education.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Kevin Gannon and Cyndi Kernahan. Kevin is a history professor and the Director of the Center for the Advancement of Faculty Excellence at Queen’s University of Charlotte. He is the author of Radical Hope: a Teaching Manifesto, which is available from West Virginia University Press. Kevin also appeared in 13th, the Netflix documentary on the 13th amendment. Cyndi is a Psychology Professor and the Director of the Center for Excellence in Teaching and Learning at the University of Wisconsin at River Falls. She is also the author of Teaching about Race and Racism in the College Classroom: Notes from a White Professor. Welcome back, Kevin and Cindy.

Cyndi: Thank you.

Kevin: Thanks. Great to be here.

John: Today’s teas are:… Kevin, are you drinking tea?

Kevin: I am not drinking tea, I have moved on to cold carbonated bubbles. And I’ve got a big vat of Diet Pepsi. [LAUGHTER]

Cyndi: I love the word vat. [LAUGHTER]

John: …and Cyndi?

Cyndi: British Breakfast.

Rebecca: Perfect. I have blue sapphire today.

John: And I have some Christmas tea, left over from a reception we had in the teaching center here about a week or so ago.

Kevin: Isn’t it cold by now? [LAUGHTER]

John: It is freshly made today, but we had a lot of leftover tea from there… with a cinnamon stick sitting in it.

Kevin: Ah, very festive.

Cyndi: Fancy, yeah.

John: We’ve invited you here today to discuss the restrictions that some state legislatures have been imposing, or attempting to impose, recently on what can be discussed in college campuses. Many of these restrictions seem to be focused on imposing alternative versions of history and on banning discussions of diversity, equity, and inclusion issues. Before we discuss these, though, is this something that’s entirely new, or have we seen this at some points in the past as well, with state intervention in academic freedom and issues of what students should be allowed to learn?

Kevin: I think this has some resonances with what we’ve seen in the past. And in particular, I’m thinking of the sort of anti-PC hysteria that emerged from so-called conservative thought circles in the 1990s. And so there’s the big curriculum debate over the National History standards that occurs in the early 90s. But what we’re seeing now with the mobilization of actual state power, I think, is an important difference of degree even if it does resemble some of the same sorts of rhetorical devices and button pushing that we might have seen in the past.

Cyndi: Yeah, the 1990s are what also popped into my mind, and it seems like attacks on higher education and on education generally, they come around in different ways, and for different reasons, it’s always an institution that is under attack.

Rebecca: So critical race theory has been the focus of many attempts to limit academic discussions of this topic. Can we start first by maybe defining what that is?

Kevin: What it is or what it has been made out to be?

Rebecca: How ‘bout both?

Kevin: I’ll actually take the second part of that first. What it’s been made out to be, is the sort of malleable boogeyman concept in the hands of pretty cynical right-wing actors, like Chris Ruffo, from the Manhattan Institute, for example, is probably the most prominent of these, who have basically admitted that this has become a stand-in for all of the things that are, quote unquote, wrong with higher education. It’s a concept that in its true sort of accurate provenance comes out of the critical legal studies movement. Critical race theory starts in law schools, and moves into areas like education, and then other areas of the humanities and social sciences to talk about how what we see as racism and, in particular, racist outcomes are not the product of individual bad actors so much as they are systemic features. It’s a counterpoint to the sort of feel-good narrative of civil rights, where people might say, “Oh, things were bad, and then Martin Luther King came along and segregation ended and then now everything’s great” and critical race theory says: “Not so fast, my friends, we need to talk about structures and systems.” And because it comes out of a discipline, Legal Studies, and is a largely academic conversation in many ways, it becomes easy to paint it with this brush of critical race theory is communism, critical race theory is reverse racism, critical race theory is anti white, because it’s such an unfamiliar concept to the general reading public that it becomes a blank slate for bad actors like Ruffo and others to inscribe whatever they wish on it.

Cyndi: I think, too, it’s important to keep in mind that that word system is a word that I think about a lot because I do think that there is a divide and a difference there around the folks who really don’t want to accept the idea that racism, along with other isms, is a systemic problem. And so I do think that, in that way, it’s really interesting to watch. One of the things that really caught my attention… I’m sure you all probably are familiar with the AP African-American Studies controversy in Florida, whether or not Floridian students would be allowed to take AP African-American Studies. As I was sort of watching, and it’s continuing with the evolution of that course, as the AP sort of responded to criticism, one of the things they did… I think they’ve since reversed this… is they took the word systemic out of the course, there was a report in The Washington Post about that and I thought, that’s really interesting, because that really is a divide where you see on the right folks saying, “we don’t want to think about this or talk about this, this is not a systemic problem;” whereas that’s not the scholarly understanding. And so that, to me, has become a really telling default line. I saw it echoed across the executive order in Oklahoma that was just handed down, I think, last week or a couple of days ago. And it was very interesting, the language around, “we want to guarantee access, but not equal outcomes” is an interesting phrasing that, to me, again, signified there’s an unwillingness to think about it as a systemic thing, which is where a lot of the fight of this becomes, and Kevin’s absolutely correct, that it does become this huge catch all. And even Ruffo himself says that in the interviews I’ve read, when they think of anything sort of bad in higher ed or education, it’s going to be critical race theory.

John: One thing that’s really struck me about this is how extensive it is, reaching from the federal level to stage to even local K through 12 school districts. We even saw some board candidates locally, who were part of one of these groups trying to restrict what students are allowed to learn. How extensive is this problem?

Kevin: Very. The Chronicle of Higher Education, for example, has a DEI legislation tracker that I urge anybody listening to this to consult regularly, because it is a fairly quick moving landscape. And I think one of the dangers for those of us in higher ed is, if you live in a state, so called blue states, you can say, “Oh, well, this is a Florida problem or a Texas problem or a North Carolina problem. But it’s not. It’s a national problem. There are states that are further down that path. But this is not something that’s just going to stay over there. And because it is a movement that is national in scope, it’s funded nationally, it is heavily bankrolled, they’re using the same sort of legislative and PR templates. Those measures have been successful quicker in some places. But wherever they’re being used, they have been successful to a degree. And so I think that’s the thing to keep in mind here is that this isn’t just some sort of localized phenomenon. It is a truly nationally oriented thing that we’re wrestling with. And I think that not seeing that is to really put yourself in danger iIf you care about the fundamental values of what we’re supposed to be doing in higher ed.

Cyndi: I want to add another resource too to the Chronicle one that I like, I think, even better. It’s the CRT Forward Project from UCLA. They have a map. I like their map a lot, because you can filter between higher ed and K -12, local versus state level. My read of that most recently is that there are 10 states that have passed legislation and at the higher ed level that is restrictive around what we teach and what we can do. And then there are lots of other states that have things in the works. So it just gives you a sense of what Kevin’s saying of just how extensive this is. And I would argue further, I would add, I think another way I’ve started to really think about this, just based on what I’m reading, what I’m seeing in my own experience, is that this is so connected to the politics of austerity. And I think we don’t think about, that we don’t connect it. But a lot of the reason why these problems are cropping up, it’s also tied to the lack of funding for higher education, which makes it more difficult in multiple ways. But it weakens us politically, it weakens what we can do in the classroom. I won’t go into but there’s a whole bunch of analyses that really connect the adjunctification of our campuses to these attacks on DEI, to the cutting of DEI positions. There really are a lot of connections there that I think you’ll recognize. And that way, it makes it even more extensive, because I would argue it’s not just the laws, it’s also that cutting our funding and not allowing us to do the work that we need to do. I think it’s connected to all of this as well. It feels like a very bought this attack on higher education and education generally.

Kevin: Yerah, yhat’s a crucial point. Look at what’s happened recently in Wisconsin, where the state boards… I don’t need to tell Cyndi about any of this, because that’s her system… but, there’s a surrender in advance to the Republican-controlled state legislature sort of diktats against DEI work. You don’t need to pass laws that abolish DEI if you make funding contingent on presidents and individual institutions doing that for you. And those things work because austerity and the sort of neoliberal approach to higher ed has created an extremely resource scarce environment where those who shepherd institutions are predisposed to sort of comply in advance, as scholars of fascism warned us not to do. And if you look at the history of the austerity movement in higher education, one of the real touch points of this process is when Reagan becomes governor of California, and Reagan and the California Republicans stick it to the University of California system as a sort of revenge for the upheavals, in particular Berkeley in the 1960s. And so a state that offered free tuition for California residents, to this sort of crown jewel university system, Reagan gets rid of it, the Republicans in California get rid of that. And that becomes a blueprint for this process that Cindy’s just talked about. We’ve seen that go national, and it’s only taken a few short decades to accomplish.

Cyndi: Yeah, one last point on that, too, that your comments made me think of, Kevin, there was a paper in economics several years ago that showed that the states that have diversified the most, if they have Republican controlled legislatures, the funding in those states goes down, and it’s connected to the diversity of the institutions. So, that’s another way in which we see this connection between austerity and diversity and politics. That’s really troubling and challenging to work with. I feel like we don’t connect these things enough, but we really do need to.

Kevin: Yeah, it is no coincidence that as the proportion of faculty and students of color have increased in higher education, that funding has decreased in almost direct variation, and that is absolutely intentional.

Rebecca: So, you both talked about many contributing factors to the growth. Can you talk a little bit about why it’s happened so quickly? And maybe, [LAUGHTER] how do we make it slow down? [LAUGHTER]

Kevin: Well, higher ed doesn’t exist in a vacuum. And we’re in the middle of an authoritarian turn, to say the least, in both international and national politics. So you have a globally connected right-wing movement. And if you look at the way that fascist and authoritarian movements have developed with the late 19th, and early 20th century, higher education and the sort of intellectual landscape are fields of play for these movements to establish power. Practitioners and students in higher education have made convenient boogie men for those who aspire to building support for authoritarianism and fascism. And so what we’re seeing, I think, is this process has accelerated so much so intensely in recent years, because we have a fascist movement in this country, and it has accelerated so much and so intently in the past few years.

Cyndi: I think there are phases where we can see effective ways to push back against this. I really do. There’s not enough of them. But there are ways to get to the second part of Rebecca’s question around like, “What do we do?” I think we have no choice but to act collectively and to work to push back together. I mean, that’s why Kevin’s point about this isn’t a Florida and Texas thing. It’s not. like I said, 10 states from my count, when I was at that CRT tracking math, and it’s on a lot of other places, and through lots of actions. So the collective action that’s inspiring to me… I think a lot about the state of Ohio… they had a bill that was quite restrictive, it would have restricted what could be discussed in general education, very similar to Florida. It had a lot of restrictions around what can be taught. And there was a strong movement against it. And what was crucial, in my reading of that, was not that it was just faculty and students pushing back, which they did, there were protests. But, more importantly, there was no compliance in advance, as Kevin mentioned a minute ago. So the regents or the board, I forget what they call it in Ohio, but those presidents of those institutions, they banded together, and they sent a letter pushing back against that. And it was the university leadership, faculty, and staff and students all pushing together against that. And that bill’s effectively dead now. It did pass the Senate, but it did not pass their assembly or else it did not become law. And this year, it has not been taken back up. There was just a word on that recently. That to me is very inspiring. That tells me that you don’t have to do this, we can push back in states that have systems. Those Chancellors, those Presidents can stand together against this. They do not have to comply in advance. They don’t have to argue with folks who don’t believe in what we do. I think that we can do that by getting everybody on board with that challenge.

Kevin: And Cyndi’s point here is essential, that institutional leadership has a really crucial role to play here. And this is where we’re seeing what I would term as a failure in so much of the leadership across higher education. You know, we’ve been told for decades that the increasing salaries of upper level administrators are because we’re bringing in bold, innovative leaders who aren’t afraid to make tough choices and hard decisions. And yet we’re seeing a vast silence from most of them as this last several years has unfolded. It’s not like the leaders of Ohio State institutions are like a Marxist collective. These are university presidents. [LAUGHTER] These are not wild-eyed radicals, but they led and the results were tangible. So if you look at things like Florida or Texas, one legal test case, pushing back against these curricular mandates as a violation of speech rights, for example. What would be the result of that? What message would that said to one’s own faculty, staff, and students? But we haven’t seen that we saw the community colleges in Florida, the presidents of those institutions issue a sort of collective statement, at least most of them, where they basically said, “Okay, fine, we’ll do all these things…” again, get this sort of comply in advance, and what message does that send to the people at your institution, because clearly, what you’ve done is you’ve abandoned your mission. That mission statement on your website needs absolutely nothing if you’re not willing to defend it against strong political headwinds. And so the main obstacle to this collective action is a leadership vacuum brought about by either moral cowardice or by leaders who actually agree with what’s happening and are willing to let these things happen to their institution because they personally sympathize with them. I don’t know which one of those is worse.

Cyndi: I think, too, there’s a little bit of an assumption that while it won’t be that bad, it can’t be that bad. They won’t really do that. And we’ve seen that a lot, too, I think. And that also is a fundamental mystery.

Kevin: It will be that bad. I’m a historian, and I can give you a reasonably expert opinion that it will indeed, if you let it get that bad.

John: Could some of this be caused by perhaps the fact that we tend to see people who have more education tend to be more liberal and perhaps might be less likely to vote for Republican candidates?

Kevin: I think there is that partisan element to it. I think that’s at the root somewhat of why this trope as universities of hotbeds of leftist radicalism is so effective, which again, takes one small slice of the intellectual and political climate at a particular institution of higher education and reads it across the entire sector, as if engineering and economics departments and business schools don’t exist. But I think that partisan element, this perception that well, here are the places where all the people who vote for Democrats live and work, is an effective one. But it’s also again, if you look at who’s wielding power and making decisions at universities, these are not hotbeds of leftism, by any means. And it’s just remarkable how successful that trope has become. It’s also, I think, an effective trope because we, and higher education, ourselves… back to Cyndi’s point about the necessity of solidarity and collective action… we have not been able to tell our story as effectively as we might. I’m not intending to get into blame the victim discourse here, but I do think that there are ways that we can advocate for ourselves and what we’re doing that have been more effective than what has usually been the case.

Cyndi: Yeah, I would agree. I think related to that point, it reminds me actually, of something you talked about in Radical Hope, Kevin, around the idea of sort of accepting this framing of what we do is we’re just only about workforce development, and we’re only about developing these sort of skills. And that’s not all of what we do. And we need to be able to talk more broadly about what we do and why it matters, and why it matters for everyone.

Kevin: Yeah, one example of this disconnect, if you look at all the surveys of prospective employers, and they say, “What are the skills that you’re looking for, for college graduates that you would want to hire into your company or your firm?” They all talk about things like critical thinking, ability to work in diverse teams, understanding people with viewpoints and backgrounds who are different than your own. This is the business community basically saying here are the things that are important. While you have right-wing politicians on the other side of the coin, saying these are the very things that we want to outlaw [LAUGHTER] in higher ed. And so I think it testifies to the power of this narrative that higher education is a hotbed of sedition, when, in actuality, most of what is in the crosshairs of these legislative and political efforts are actually things that are, on the broad face of it, not controversial, and generally agreed upon by almost all of society as good things to have.

Rebecca: I think to make collective action work effectively, folks need to be somewhat on the same page. And so if people are supporters of diversity, equity, and inclusion, but aren’t aware of counter arguments against that, it might be hard to take action. Can you talk a little bit about why folks are so opposed to these efforts?

Cyndi: My read of part of it goes back to that idea of racism as a systematic problem. There’s a lot of research on K-12 education around race that shows that, particularly for white Americans, but really across races as well, you see it as sort of a fundamental misunderstanding of what racism is, how it operates, how systemic it actually is. Part of that is because we’re in the United States, which is a very individualistic place and so we tend to think in terms of those problems, even the way often that DEI is framed, it’s very individualistic. And so we don’t think of it as a broader systemic thing. And that keeps us from acting collectively as well, because we’re not really thinking about it in that terms. I see that a lot. That is my main teaching and learning goal, when I teach about racism or other systems of oppression, is just to make that shift, sort of the individual acts of meanness over to this more systemic understanding, and understanding that really the most important things like, I constantly get the question from a lot of my students: “Well, okay, so what do I do about these problems? What should I learn more about?” and then like, “If you can learn more, that’s great. Like, I want you individually to learn as much as you want. But if you really care about this, you have to think about policies and voting, and what broader policies are being enacted.” And I try to give them examples just to help them start to think more broadly about these things. And I think that disconnect is part of it. Because if you believe that it’s just individualistic, it’s just about being a good, colorblind person, which is also often tied into one’s morality, like “I’m a good person, so that’s all I need to do. I don’t necessarily need to think beyond that.” And so then it makes sense if you are told over and over again, that there are these DEIi administrators trying to force you to have particular thoughts. It kind of makes sense from that perspective that you would want those thoughts, and that you would think they were going too far on the college campuses. But if you understand instead, that it’s not about color blindness, and it is this broader systemic thing and there are broader problems of not just access but opportunity and outcome, then that changes. But until people start to understand those broader things, I think it’s always going to be a struggle.

Kevin: Yeah, I think Cyndi’s point about us living in this overwhelmingly individualist sort of society and culture is a key foundation, a key part of the answer here, because one of the things that surprises me a little bit is that arguments like the one that Heather McGee makes in her book, The Sum of Us, that those haven’t gotten more traction, where she talks about the famous anecdote she uses is during desegregation, states in the South would close their swimming pools rather than integrate them. And what happens is, all these communities now don’t have a swimming pool at all. And so part of that is to the white folks of that community, rather than the swimming pool complexes racially integrated they went without. Is that really a good outcome? Taking the moral element out of it, it’s like, here’s a public good that is no longer available for the public. And so what racism does, McGee argues, is it hurts everybody to varying degrees and in different ways, but it’s actually something that is poisonous to the very roots of any sort of people that would claim to live in community or society with one another. And I remain discouraged that that argument has not gotten more traction, because I think we need to appeal beyond this sort of sense of individualism. Like Cyndi said, like, “Well, I’m a good person, so racism doesn’t exist. These other racists are bad, but we can quote unquote, educate our way out of it, or a magical black person like Martin Luther King, Jr. will come and absolve everyone from their sins,” right? And of course, that’s not how it works. But this tide of individualism, this conditioning that we have, is so powerful that it makes systemic critiques into a sort of existential threat for folks who are not ready to make that journey, because it becomes a threat to an individual to say, if you live in a system that is fundamentally racist and inequitable, for example, if you subscribe to this sort of inherent individualism as the core of your identity, that a systemic critique says, “You live in this system, and it’s your fault, at least partially that the system is like this.” And if you can’t separate those two out, and if you can’t make those distinctions, you’re not going to have a very useful conversation about what we would term as DEI. And instead, what you get is you get anecdotes of, let’s say, unskillful students making an argument in some inelegant way that is an easy thing to lift out of context and present as here’s what DEI is, these lefty kids running amok protesting food in the dining hall at Oberlin, for example, and turning it into a kind of theater of the absurd. And so we’re swimming against such a powerful cultural tide when we try to do this work because it is asking people at least to set aside this fundamentally individual centered ethos. And that is a really heavy lift for all of us, I think.

Cyndi: Although I have some good news, if you guys want to hear it.

Rebecca: I’ll take it, I’ll take it. [LAUGHTER]

Kevin: I would love to hear good news.

Cyndi: This just comes from my own individual teaching experience, because what Kevin’s talking about is a powerful argument, the sort of Heather McGee’s and there are others too. And what I’ve started doing, and I’ve found that post-2020 It’s become a little bit easier for this to get purchase in terms of teaching. I really do think that there is a lot of hope in our teaching. One of the ways that I’ve started to help my students cross that bridge, that divide from the individualistic to systemic is to have think in terms of their own lives. And one of the most clear examples to go all the way back to like sort of where we started, it’s like they pay more for college tuition as a result, I would argue, of racism, and sometimes some forms classism, too. And there are several ways to get at this. Heather McGee, in that great book, The Sum of Us, that Kevin mentioned a minute ago, she has a whole chapter on college funding and how it’s gone down. I mentioned the economics research that shows that. So these austerity policies that are related to diversity and racism and fear, frankly, cost a lot of white students, particularly students that I work with, tend to be first generation, a little bit lower income, and I know you all do too, as well, at your institutions. Public regional institutions, and not private, we serve a lot of students who are directly affected by these austerity policies, they’re directly connected to race. So again, I mentioned Heatherr McGee. I also have another great resource that I’ve been reading, it was written by a couple of sociologists about the racial consequences of underfunding public universities, they look at two schools in the California system. You don’t have to give all of these to students. But it turns out that it’s very easy when you work with students to sort of talk about, let’s think about what systemic racism means. Here’s a way it impacts you directly. My classes are overwhelmingly white, but speaking with white students about that, and helping them connect those dots, they can do it. And part of what I think has helped us, that’s a strange way to say it, but post-2020, is that after 2020, people started using the word systemic racism a lot more like in social media. So I have more students that will come into my courses, saying that word, I don’t think they fully appreciate what it means. But it’s more of an opening. And so then we can start to think about all those ways in which it is harmful to everyone. Racism is harmful to everyone, it costs all of us more than it should in lots of ways. And not just in terms of like sort of the moralistic framing that we often use, but real material differences. So that’s one way that I found hope, I guess, it’s to go back and to think about how to teach about these issues in a way that feels good. And I think there’s a lot of things instructors can do, no matter what they teach, to sort of start to get out these issues and help students to think about it.

John: I’ve seen some similar things. And one thing I’ve noticed is that as our classrooms become more diversified, as we have more first-gen students, as we have more students from historically minoritized groups, we’re seeing people in general becoming much more aware of some of these issues. But one of the challenges, as you both have mentioned, is the issue of austerity that colleges have moved to a more contingent labor force, there’s a larger proportion of adjuncts. And while it’s important to be able to push back, many of the people doing the labor of classroom instruction are in a position where their jobs are very much at risk. And if their administration is not going to be supportive of DEI efforts, they face losing their very limited incomes that they’re receiving from these positions. Is there anything we can do to address that challenge?

Kevin: Again, I think part of the answer to this goes back to the idea of leadership of institutions. What is the mission of your university or college? What are you saying that you’re going to be doing? Why are you there? Our mission statements as institutions are promises that we make to all of the stakeholders of that community, whether they currently are part of the community or external groups in the town in which we’re situated in the area, for example, potential students and their families, we don’t put Terms and Conditions on our mission statements, we say that X University will provide a powerful educational transformative experience to all of our students. We don’t say all of our students who meet a certain income level or all of our students who come from certain demographic groups. We mean all of our students. And so if we’re going to do this mission driven work, and we’ve got study after study after study that talks about having a diverse student body and a diverse faculty and staff, not just racially and ethnically, but diversity and all of the ways that matter lead to better learning outcomes. In other words, we do this education thing better when we do it in diverse places with diverse people. And if that’s what you want, which I would argue we do, then that’s what we need to lean into. And so if you’ve got folks who are doing that work, who are not supportive, who are contingent and precarious faculty and feel that they cannot do what is, I would argue, inherently mission aligned work, that as an institution, that is a problem. And you need to do something about that. And so if you’re a department chair, how are you supporting your part-time colleagues? If you’re a professor with tenure, how are you supporting your part-time colleagues or your junior colleagues who aren’t tenured yet? How are you providing cover? How are you modeling things as a secure person in a secure position? How are you advocating in governance? How are you advocating in Provost’s Council or a senior leadership’s cabinet? How are you looking at getting rid of just semester-based contracts and moving towards annual- or several-year contracts? You can’t wipe out precarity at a single swoop. But what you can do is fix some of the sharpest edges of it, to blunt those. That’s the work in front of us in the short term. And if you’re not supporting your colleagues doing that, that none of this works… Again back to Cyndi’s central point, we either do this collectively or we don’t do it at all.

Cyndi: Yeah, I think anybody with any power in any sort of safety, and I use safety in quotes, but like anybody who can has to push back, and this pops up in really small places that you might not recognize. I was reading too about the southern accreditor, I forget what their official thing is. But you know, they’re talking about changing the accreditation, that is absolutely compliance in advance. That is the wrong way to go. Our accreditors, that’s part of what worked in Ohio, where the arguments about it were going to be out of compliance with accreditation. If the accreditors are complying in advance, and watering all this stuff down and not sticking to the mission, that’s a problem. So there are a lot of people who have a lot of power and the ability to push against this, but you have to push against it. All of us do, in all those spaces that Kevin just mentioned, because reducing the harm and softening those edges as much as we can, it’s our responsibility to do that, particularly for people who are adjuncts and semester-to-semester contracts, because that precarity is real, and it is a problem. And I’m sure you’ve all seen it, I have seen it too. And we can work with our students, because our students will work with us. They believe in these things. The ideas we have about students are so often wrong in terms of that. So working with our students and not believing in caricatures about students.

Kevin: Yeah, that’s an essential point, Cyndi, and thank you for raising that, because I think one of the things that we haven’t touched on here, but is a vital thing to bear in mind, is that these legislative efforts are profoundly anti-student. They’re not just anti-higher education, they are profoundly anti-student, anti-young person. They make the assumption that learning only happens through indoctrination. They are based on the premise that students will learn only what is sort of rammed down their throat, basically, pedagogically. They make the assumption that students cannot handle certain truths. They make the assumption that some things just aren’t worth knowing, and they take that decision process out of the students’ hands. They are profoundly anti-student. Among all of the other things they are, this is the essential truth at its core, that these laws, this legislative effort, this broader cultural political campaign is based on a profound contempt for students, for young people, and by extension their families. And so we need to understand that our students want the same thing for them that we want for our institutions. And if we’re able to see our students as allies in this and get our students to see themselves as allies in this, nobody wants a crap education. Nobody wants an indoctrination, force-fed prefabricated chunks of content. We know that doesn’t work. And so to engage the student voice in this in a systematic and supportive way, I think, is a really important part of the equation and a great untapped opportunity across our institutions. But that needs to be, I think, one of the ways in which we push back against these efforts is to really call the fact out that y’all just hate kids. Y’all hate learners, you don’t just hate schools and instructors, you hate the people that these institutions are ostensibly trying to serve. You may say that these are pro-children and pro-family, but they’re not. They hold children and students in profound contempt. And we need to hammer and hammer and hammer on that point, because that’s the reality.

Rebecca: Change is only likely to happen when the whole community’s engaged. So you’ve outlined today: administrators, faculty, staff, students, the whole community working together,

Cyndi: We have a lot more power than we do.

Kevin: Yeah. Scholars of fascism and authoritarianism will point out the fact that the one thing that successful movements of this stripe do is they get you to give up your agency and oftentimes without a fight. So that’s why complying in advance, the phrase that we’ve used several times, it’s so dangerous, because we give up our agency, we forget that we have it, and then it becomes much easier for these movements, which are not representative of the majority, not representative of our community or it’s aspirational values, but it allows them to be successful because the great majority of folks have given up agency. And so as long as we not just recognize the agency we have, but deploy it effectively, then, and only then, can we push back successfully.

John: We always end with the question: What’s next?

Cyndi: What’s next is I have a final tomorrow. So that’s probably like what’s most salient in my mind. So, you know, wrapping up this semester, but definitely more seriously, I want to think more about these questions and how to get people collectively to think about these larger points, about just what Kevin was saying about the real paternalism and contempt for students that is evident in the laws, helping students to understand what this is and why it matters for them, figuring out how to write and speak and work with people more to get people to see the power that they have. We don’t have to do this. We don’t. We can keep our education systems and classes free from this interference, and we should.

Kevin: And I think, for me, as someone who works in Educational Development at a private institution. I think that those of us who have a little more latitude, we’re not immune from any of this, but we do have some affordances that public institutions don’t. And so it’s part of my job to help my colleagues and to build a model of what this looks like to do well. What does it look like to do this work in solidarity and community? What does it look like to do meaningful, as opposed to just performative, work along equity and justice oriented teaching and learning, because it’s so much easier to advocate for these things if we could point to concrete examples of what they look like, how they can sustain themselves, and what the benefits are. And so I think as an educational developer, that’s kind of my responsibility, what I feel bound to continue. And I’m fortunate to be in an institution that values those things. And so I need to take advantage of the climate I’m in to advance that work.

Rebecca: Well, thank you so much for joining us and giving us plenty to think about and ways that we can perhaps act by modeling and coaching and working to have collective action.

John: It’s always great talking to you. Thank you again for joining us, and we’re looking forward to more conversations in the future.

Kevin: Thank you for having us.

Cyndi: Yeah, thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

326. UDL in Action

Universal design for learning, or UDL, is a framework to help us design more equitable learning experiences. In this episode, Lillian Nave joins us to discuss how she has implemented a UDL approach in her first-year seminar course. Lillian is the Coordinator of the Center for Excellence in Teaching and Learning for Student Success at the Appalachian State University Hickory Campus and a senior lecturer in a first-year seminar course at Appalachian State University. She is also the host of the ThinkUDL podcast. She is the recipient of several teaching awards and often serves as an invited speaker on UDL issues.

Show Notes

Transcript

John: Universal design for learning, or UDL, is a framework to help us design more equitable learning experiences. In this episode, we discuss how one faculty member has implemented a UDL approach in a first-year course.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Lilian Nave. Lillian is the Coordinator of the Center for Excellence in Teaching and Learning for Student Success at the Appalachian State University Hickory Campus and a senior lecturer in a first-year seminar course at Appalachian State University. She is also the host of the ThinkUDL podcast. She is the recipient of several teaching awards and often serves as an invited speaker on UDL issues. Welcome, Lillian.

Lillian: Thank you very much. And I applaud you on all of the monikers that I currently have attached to my name that often don’t make sense. So, very good. And of course you said Appalachian in the way we say it down here in North Carolina and I don’t have to throw an apple at you. [LAUGHTER]

John: Well, I’ve heard it so many times on your podcast that I wanted to be sure we got that down.

Rebecca: Today’s teas are:… Lillian, are you drinking tea today?

Lillian: I am and I brewed it specially for our interview today, it is Bengal spice, which is a Celestial Seasoning herbal tea that is caffeine free. I went caffeine free a while ago, and it’s fantastic and I don’t have to put sugar or honey or anything in it. It has cinnamon sticks and it’s delicious and my best friend in the world got me hooked on it. And it always just makes me feel warm inside and makes me think of the lovely conversations I have with the people who I’ve drank tea with in the past. And I also have iced tea because I continuously drink iced tea and this one happens to be actually just a Crystal Light [LAUGHTER] iced tea as well.

Rebecca: And I did notice, of course, and must state that there was a Tea for Teaching mug involved.

Lillian: Yes, exactly, and I appreciate that. John saw me at a conference and I was so happy to get my Tea for teaching mug that I made sure I was drinking from it today.

John: And I am drinking a peppermint spearmint blend today… also caffeine free today.

Rebecca: I am drinking a highly caffeinated afternoon tea [LAUGHTER] to make up for everybody’s caffeine deficits.

Lillian: Well, I have plenty of chocolate throughout the day that is not caffeine free.

John: So we’ve invited you here today to discuss your work on Universal Design for Learning. We probably don’t have many listeners who aren’t familiar with UDL, but for those who are not as familiar, could you provide an overview of Universal Design for Learning.

Lillian: Of course, and I’d be glad to. Universal Design for Learning is a way of thinking, I would say, about teaching and learning that relies on three main concepts that include: engaging your students, providing accessible materials for your students, and varying the ways that your students can explain to you that they’ve learned something. And it is all based on neuroscience and also a lot of research that tells us that all of our students are different. Variability is the norm. And so we have students in higher ed that come from all different backgrounds, different cultures, different preparedness levels, different abilities and disabilities. And in order to reach all of our students, it’s important to think about that variability and universal design for learning gives us some really specific things to look out for. And three areas or categories: the engagement, the representation, and providing multiple means for those and multiple means of the student to express their knowledge. And so that’s like the general overview, but there are like so many weeds, that I can have a podcast [LAUGHTER] and talk to people about all of the different intricacies of UDL. But in general, that’s it in a nutshell.

Rebecca: I know we’ve talked about it a bit on our podcast before in terms of the difference between UDL and accessibility. But for those who haven’t heard those previous episodes, can you talk a little bit about the difference between those two ideas?

Lillian: Yes. So, accessibility is a part of Universal Design for Learning. You cannot have universal design for learning without attention to accessibility. But accessibility alone is not universal design for learning, it’s a part of it. And I like to think of UDL as like a three-legged stool. If you take out one of those legs, the stool doesn’t function anymore, it will fall over. And one of those legs is multiple means of representation. It’s typically the center column that’s purple if you look at the UDL guidelines at UDLguidelines.org. CAST puts those out. And that middle column about representation is about providing multiple forms of representation, so different texts or audio files, or making sure your font is readable too, especially for dyslexic students. So accessibility is about making sure that all students can access materials, that they have the ability to make sure they can actually get at that information. And this is less common now, but there used to be like those PDFs that a professor copied out of their book when they were a student and it has all their like markings and stuff in it. And then they would just like make a read really bad copy of it, and hand it out when everybody still used paper all the time, or maybe it’s on a screen. And those oftentimes were not accessible. And that means if a student needed a screen reader to read it, or even if they just needed to make the font bigger, they couldn’t because it wasn’t an accessible document, a screen reader couldn’t read it, meaning if a student was dyslexic or even blind, they had really no way to get at that information. So when you make your documents accessible, and you make your class accessible, you are making sure that everybody really just is on an even playing field, and they can get at that information. But in addition to accessibility, you want to make sure you’re also giving lots of opportunities for students to express what they know in different ways. And you’re also engaging with the students. And those two other things are not included in accessibility. That’s what makes up UDL.

John: How did you become interested in UDL?

Lillian: Well, I started working with our Center for Teaching and Learning in 2016 as a faculty fellow and I started doing faculty development as a one-course release for quite a while. And in doing that, we became part of a grant that was in three North Carolina institutions that was called College STAR. And STAR stands for supporting transition, access, and retention. And it was a two-pronged approach where there was a lot of student development, so tutoring centers and things like that. And then there was this other side, and that’s the part I got interested in and got pulled along with and that was supporting faculty. And to do that we used Universal Design for Learning. And I was just part of that grant. And that ended up me being the Universal Design for Learning Coordinator at Appalachian State. And I started going to different departments and introducing that at workshops and that sort of thing. So I became kind of the UDL girl or UDL lady for App state, which I think is about 2016 when that started, and then I saw it, like I’d never heard of it before, and I’d been teaching since 1997. And then I thought, oh, boy, this is really good, this makes a lot of sense. And so I started implementing it as well in all my classes.

Rebecca: So we’ve talked a little bit about UDL principles broadly. So can we dig into maybe a specific example, like your first-year seminar course? That sounds pretty interesting.

Lillian: Absolutely. So my course right now, I teach one called intercultural dialogues, and I get first-year students, and so I love it that they’re small, under 24 students. This past year, I was at our new campus in Hickory, and I only had 18 students there. And we get to work on intercultural competence, which is one of those major things that colleges want our students to know. It’s a 21st-century skill, and it is about understanding our own cultures, and then understanding that other people have different cultures. And then how can you mindfully act and interact with somebody from a different culture. And I have heard some students, at the end of the term, say “this is something everybody should know, like, this is really, really important.” They’ve seen how important it is. But at the beginning of the class, like nobody wants to be there. Nobody wants to take a first-year seminar course. They’re usually there because it’s Tuesday morning and they have an open slot. I’m in that unenviable position of teaching first-year seminar, and it’s that Gen Ed requirement that nobody wants to take. So I want to make it interesting, and I want to make it worthwhile for them, and so we learn about our own culture and then I also match students up with students abroad. We’ve worked with students in Doha, Qatar, in China, in Morocco, in Germany, Thailand, and Japan in the past year, and they work on intercultural competency skills and talk about things like power distance in the classroom, or some of the UN Sustainability Development Goals, like gender equality by 2030. And so they’ve done some things with students in China about that. So the class itself is about intercultural competence. And I have infused a bunch of UDL into this class over the years. And so it wasn’t all at once, but it took a while. And so that means I have multiple ways for the students to get at that information. So there is never just one way to do the reading. It’s either accessible or I’ve recorded a voice audio file for students. So we have a lot of commuter students at this campus, and so actually, we have zero students who live on campus in our new campus in Hickory. It is a new campus, it just started and so there are no dorms, there’s only one building and we’re all in that one building. And so students come in, they have jobs, and so UDL is very helpful for me to think about those students who have various commitments of their time. So they could listen to the audio file rather than read the book, because they’ve got a 40-minute commute to come into campus or something like that. So they’ll have an audio or video. I’ve used H5P, which is on our learning management system, which is like an interactive video, there’s VoiceThread, which is another way to be kind of interactive for students to participate. And so there’s always multiple ways for them to get at that information. And then there’s multiple ways that I ask them to tell me what they know. And they’ve done concept maps, so we have very little like, “write me a paper,” there’s very little of that my class. And that’s also a culturally competent type of teaching thing, because we often in an individuated, Western academic model, we prioritize reading and writing, reading and writing, reading and writing. That’s always what it is. And yes, we need to have very good readers and writers. But there are lots of other ways to learn and express your learning that might be more prevalent in other countries and in other cultures. And so they’ve had to draw some of their answers, they’ve had to give me a visual representation, they’ve written a poem, drawn a cartoon, and tell a story. One of their first assignments is to bring in something that expresses who they are, a cultural artifact. And then the last class that we just had recently, I asked everyone to name everybody else’s cultural artifact, so they learned about each other that way. And it was things like a keychain or one student brought in the T-top of his T-top convertible car. [LAUGHTER] Because the car was really important to get him around and all that stuff. And engagement is the last part. But it’s really the first part that gets students interested in the activities and in the learning and why they should learn. So I start off with a liquid syllabus, which is a syllabus that students can access outside of our learning management system, and they can see what we’re doing, and they get a video of me talking to them. And that’s supposed to be engaging. And then they have a lot of authentic assignments working with students overseas. And this year, because I was finally back in an actual classroom and not doing remote teaching, as I have been since 2020, I took students up to New York City. And Appalachian has this amazing loft that actually anybody can go stay at so all of your listeners could go and stay at Appalachian’s loft, and it’s very inexpensive. It’s like $70 a night per bed, and it’s these two rooms of 10 beds each. And we took students up there to actually learn a lot about culture. We went to the Tenement Museum, they looked around, and it was very cool. So experiential type of education as well. So that took like years before I got to that rendition of how I teach that course. But those are all UDL principles that guided me.

John: You mentioned collaboration with students in other countries, what types of collaborative work did those students do in your classes?

Lillian: They had specific zoom meetings that they had to do personally one on one. So one of them is that students got matched one on one with fellow students in Morocco. And they were supposed to talk about the difference in power distance in an educational setting. So power distance is the amount of power that people in a group expect and believe should be shared or held by the people in that group. So in an educational setting, if you’ve got a first-year student who comes into a large lecture hall on a college campus, there is a larger power distance for that instructor who will pretty much lecture to those students, students don’t raise their hand all that often, there’s not a lot of back and forth, there’s not a lot of flexibility, they probably don’t even know the students’ names. And so that would be an example of a larger power distance. A smaller power distance might be in a classroom, like in my classroom, I say, “You can call me by my first name, you can address me in this very informal way. We’re not going to have a lecture, we’re going to be in small groups, and then we’re going to share our ideas.” And that way, there’s a lot more voices, there’s a lot more talking. And that can happen in various times throughout the semester. I may do a lecture, I may not. And so my students were talking with students in Morocco to find out about their understanding of what power distance was. And do you call your professor Dr. Smith? Or what do you address them by? Are there rules about when you can address your professor and those sorts of things. So that was one of them. And then we worked with students in China, and this one was a series of three Zoom conversations. And all of our students had to set all these up. They were all in English because our partner students wanted to do this in English, and most of them had never spoken to a native English speaker. So this was a really good goal for them. And in China, they can’t have Zoom, not allowed. And so the students had to receive our invite from our students, and their first session was kind of an introduction: who they are, what they’re doing, for about an hour. The second was a second list of questions, which was about: Who takes care of children? Who goes to work? Who do you live with? Do you live with an extended family? Do you live with a nuclear family? And it was really about gender roles. And one of those things that’s a national cultural dimension is something called achievement versus nurturance. And that continuum has also been called in the past: masculinity versus femininity. And it’s how much a culture believes that men and women should adhere to somewhat stereotypical gender roles. So are there women CEOs, and stay-at-home dads? In some countries, that happens in some cities. That happens a lot more than in other countries. Do you put more emphasis on earning a higher wage? Or on having the flexibility to work from home? Like, where are you on that? And so the students talked about that. And then in the last session, they talked about: if you could change anything, what would you see that might improve your country from where it is now and that sort of thing. So they got to do some really authentic conversations with people around the world, and the students in China were 12 hours ahead. So my students were meeting sometimes at two in the morning, but they were up, [LAUGHTER] it didn’t matter.

Rebecca: So it sounds like there was a lot of coordination with counterparts around the world to make sure that you designed experiences for both sets of students that met, maybe not the same learning objectives, but learning objectives that were relevant for each population.

Lillian: That is exactly it. And it was my colleague in China, who said she wanted to do something about the sustainable development goals from the UN. I said, “Okay, well, let’s try and look at that.” And it worked for each one. And it is a lot of coordination for the faculty. And so I would meet with my fellow faculty member several times throughout the semester. And so we got the dates right for when we’d have Thanksgiving, nobody else had Thanksgiving break, and we have holidays, and they started a month early or a month late, and so there was a lot of coordination. And then they had to give me the list of all the students and I needed gender, too, because some students wanted to stay within their own gender, women, especially, in Morocco where some were less likely to speak to male students, who wanted to stay with female students. So we wanted to be culturally sensitive to those types of things. So there was a lot of beginning coordination to set those things up.

Rebecca: I wanted to circle back to one other thing you said too, in that you mentioned your classes developed with all these UDL principles over a significant period of time.

LILIIAN: Yes.

Rebecca: I want to know how you got started, what was the first thing you implemented? And how did that set a trajectory for the others?

Lillian: The first thing, way back when, probably 2016, 2017, like the big aha moment for me, was not doing the same thing all the time, and not having to grade everything, meaning maybe we were just going to do some honestly experimental assessments in class that were kind of fun and authentic. And I didn’t have to grade everything. And when I kind of let go of that, it opened me up to some more ideas. And then I thought, well, I don’t need them to write a paper, because I really have a specific goal in mind. And the goal doesn’t necessarily need to be a paper that then I’d have to read, [LAUGHTER] it made my life easier too. Maybe they just needed to demonstrate their understanding of these concepts. And so like one of the first things we do is draw an iceberg, and talk about how the culture that we see here, taste, feel, smell, all those five senses, that’s about 10% of what makes a culture. And when we think about culture, it’s usually just those things, it’s like, “Oh, you eat this special meal on Lunar New Year, and you have these special foods, and the kitchen always smells this way, or we dress up in cultural clothing, or whatever.” But that’s really only 10%, the tip of the iceberg. And then we have to get really deep into what our values and beliefs and assumptions we make. And that’s typically the hard part of the class. And so I just had students either draw an onion or an iceberg. And then they had to kind of point to where this was, what are your deeply held beliefs and assumptions, and that culture is so much more. And it’s a lot easier, I think, to conceptualize it as a drawing than it is to write me a paper about what your deeply held beliefs are, [LAUGHTER] and where they align with the things that I can see on the outside.

John: You mentioned that the first thing you had done was reducing grading and doing more formative assessments, which is beneficial for students too because it takes some of the pressure off and gives them the opportunity to try something, make mistakes, and learn from that without any penalty. Is that something that you’d recommend for someone who’s interested in exploring UDL, as a first step, if they’re not already doing that?

Lillian: Absolutely, I think it frees up both the student and the faculty member to kind of see what works. And so much of Universal Design for Learning is about feedback, feedback from the students. And that is a major portion of UDL. And I should have said that at the very beginning, that you really want to be figuring out what works for the students and what works for you. So I do think that’s a great way to think about it. And also, the flip side of that coin, to me as well, was whoever is doing the work is doing the learning. So if you are always lecturing to your students, it’s hard, like, you got to put together this great lecture, I always felt like I had a top hat and a cane, you know, walking into my lecture, and yadda-dat-dah, I’m gonna, like dazzle you with my art historical knowledge, and make it interesting. And I was doing a lot of work to do that. And I have slowly moved into kind of the other end of this continuum, from lecturer into facilitator. And if I can facilitate the students working together, or a lot of feedback back and forth with me or with each other, then they’re actually risking some things like “talk to your neighbor about this,” and they don’t have to raise their hand in front of the large class, they’re actually trying and risking and doing these smaller things. And that’s where I see the learning happening. If they’re just listening, that’s fine, that’s great too, but the more they can participate in their own learning, the better it is, that I’ve seen, certainly in my classes, the more they can do, the more they’re learning. But it doesn’t mean I have to evaluate every single thing that they hand in, or that they produce. And I can certainly, on the spot, kind of tweak things and say, “Okay, let’s turn it into this direction,” or something like that. But it was the: “I don’t have to grade everything they do” and “The person who’s doing the work is doing the learning.” And it was like freedom for me to try all of these things that were totally not what I had done as a student, or had valued as a student or an instructor because I was very much in that: “Alright, you’ve got a 15-page research paper, a midterm, and a final, and that’s the art history course.” And I don’t do that anymore.

Rebecca: Well, it sounds like not only is there a benefit to the faculty, in terms of workload, joy, [LAUGHTER] etc, but also an emphasis on self efficacy for students and building confidence.

Lillian: Oh, yeah. Exactly. And they’re trying things out, and they’re seeing what works. And that feedback is really important, a big part of UDL.

John: And you mentioned that it took you time to build to where your courses currently are. Is that an approach you’d also recommend to faculty who are beginning to introduce UDL principles, because it can be a lot of work completely redesigning or transforming your teaching?

Lillian: Absolutely. I don’t know if I could have done this stuff early on in my career, because I was worried about how I looked and was perceived. I was very young, and so I think I needed to feel like I was in charge. And that power sharing was too difficult for me as a young instructor. So I understand that. And now I feel much more comfortable in the classroom. And I feel that being a facilitator is really helpful for the students. And sometimes they just want to sit and listen, but that happens too. But it took a long time to get there. And the course has evolved over a long time. And you try new things. Tom Tobin and Kristen Behling talk about the plus one mentality, just trying one new thing. And that’s what happened, is when I started this course, we weren’t speaking with students in other countries. That just sort of happened when I went to a conference and made some friends in other countries and said, “Oh, I bet this would make a lot of sense to add this in.” It’d be really authentic, which is one of the engagement principles is having really authentic learning experiences. And I used to be like, “Oh, you’ve got to plan everything out, and it has to be perfect.” And now I see that I fumble through a lot of things. And every once in a while something sticks, and it’s good. It’s a practice. They say being a doctor is more of a practice. I think being a teacher is very much a practice to see what works and what worked in my class five years ago, doesn’t necessarily work now. Things that were really fun and hot at some point, you know, like making memes is pretty fun right now, but we didn’t do that 10 years ago, and we probably won’t do it in another five years, like, what did you learn? Let’s make a meme out of it. It’s evolving.

Rebecca: It’s interesting that we’re talking about a course about culture. And you’re describing how the culture of higher ed or institutions or our classrooms also evolve. And that evolution requires risk both on the part of the instructor as well as on the part of the students, and that the UDL principles are really allowing that risk to happen on both ends.

Lillian: Yes, and sometimes there are forces outside of our control that make that more difficult, and it’s not an enviable position. So things like I wish I didn’t have to grade, but we still have to have grades in the end. And so how does that fit into your course. And so I know a lot of folks are using ungrading. I know you’ve talked with Susan Blum and Josh Eyler about various different kinds of grading, which I think is like a later on kind of thing for UDL. Start with accessibility, make sure your stuff is readable and devourable by all of your students, and then start kind of playing around with it. And then maybe I think that ungrading or different kinds of grading structures might be the last step on that process. But to each their own.

John: One of the issues involving student variability is that some students might be resistant to some of the approaches that you’re using, because there have been a number of studies that show that students often prefer to be lectured at. And it seems like they’re learning more that way, despite the evidence that that’s less effective. How do you persuade students to be open to trying new approaches to learning?

Lillian: Great question, I know exactly what you’re talking about, like students, they’re like, “this is how we learn best,” and then you actually poll their knowledge. And students in an active learning situation who kind of hated it are much more knowledgeable than the students that were just in a lecture where they really liked it, because that was kind of safe. And in the last year or so I’ve heard myself saying this a lot when I do speaking, and when I’m talking to folks, is I think everybody needs to be uncomfortable in the classroom, some of the time. We don’t want the same students to be uncomfortable all of the time. So that means varying those different ways that we assess students, so it’s not the “alright, every week, you’re writing a paper,” oh, that also gets boring. But for your great writers, it’s fantastic. But are we really finding out what that student knows? Are we finding out that they’re a good writer. And so maybe that’s a poem, or maybe it’s a concept map, or there are other ways to assess that info. And so I tell my students, like, I’m really conscious about that, like, you probably aren’t going to like some of these things, but your neighbor isn’t going to like the next thing. And so having those opportunities that you have to step out of your comfort zone, to get into the learning zone, but not all the way out to that outer edge of the target, which is the panic zone. And that’s actually an intercultural competence idea that I learned in that field. When you study abroad, the only way you’re really learning is if you’re in that learning mode, like if you go to Germany, but you’re living with a bunch of Americans, and you never speak German, and you go to McDonald’s, and you’re at an English speaking school, then have you really learned much about German culture? So you should go outside of that comfort zone. Maybe you’re living with a local family, and you have to speak German, but you don’t want to go and you are in like a chaotic household and they don’t speak English, and they haven’t made sure that you have any food, and you don’t feel safe, and all the classes you are way ahead of you in your German speaking. And so you’re not learning much either, you’re kind of panicking. So it’s that learning zone we have to be in and so I think in our classrooms, we need to do that too, have multiple different ways for students to express what they know, which is one of our UDL guidelines. And I am very overt when I tell students that. And I found that with student evaluations, like I would get student evaluations where they asked like, “Did you practice critical thinking skills?” And they’d be like, “No, like, I totally didn’t at all.” [LAUGHTER] And then the next year… and I think I learned this at like an academic conference… the next year, throughout the course, I’d be like, Okay, we’re gonna do this critical thinking exercise, this thing that we’re doing right now, this is about critical thinking, you’re going to use your critical thinking skills because this thing that we’ve done, that’s a critical thinking skill. Guess what? The evaluations… way up. [LAUGHTER] Exactly like you’re pulling back the curtain and you’re saying, like, here’s actually why we’re doing it, and this is what you’re doing. And so I think explaining that is really helpful. And then the students know why they need to do something like what I’ve asked them to do, why am I writing a poem or why am I drawing an iceberg? And I think we do need to tell students that and not just have them guessing, because then they’re going to be in the panic zone and not learn so much.

Rebecca: That’s a really good point to remind students that being uncomfortable and taking risks is actually part of the learning process. Can’t remind them too much.

Lillian: Yeah, exactly. It’s necessary. And they do want to just sit and doodle. And not that doodling is bad. But they just want to sit and listen and have us do all of the work. But it’s like, I know this stuff, so why do I need to explain it? You could just watch a video of me talking. We need to get you into grappling with this and doing the stuff that I know you don’t want to do and you don’t want to be here because it’s a first-year seminar and you’re a first-year student. So my heart is with all of those folks that teach Gen Ed [LAUGHTER] to the students who don’t really want to be there.

Rebecca: Switching gears a bit now, can you talk a little bit about how you started the ThinkUDL podcast?

Lillian: Yes, it’s going back to that College STAR grant. We were getting into doing like workshops, and so I was working with other universities in North Carolina. And we had a PI, the head of it was at our East Carolina school. And I said, “Do we have any multiple ways to do this. They were doing research and then some workshops. And it just made sense to me like, we need a podcast, like this would be so off brand for UDL not to have multiple means for us to get this information out. And a podcast has the added bonus of being asynchronous, so people can listen to it whenever they want. I’ve always had transcripts, too. So if you don’t want to listen to my voice, which is totally fine, you could read the transcript and you can get that information, you can see the resources. So there are multiple ways to get it. But there was money from that original grant that sent me and my shout out to Tanner, who was my first sound engineer, and we went to a podcast convention in 2018 in the summer in Philadelphia. And seriously, I didn’t know a thing at all. I didn’t even listen to podcasts then. The only one I’d heard of was the Teaching in Higher Ed with Bonni Stachowiak, and then like, “Okay, we’re gonna try it.” And the very early episodes are, I think, awful. But luckily, Tanner kind of cleaned them up. But there was a Chris Farley on Saturday, live long, long time ago, so I’m showing my age here. But he would interview, in these sketches. He’d interview people that were amazing, like Paul McCartney from The Beatles, right? And he would just fumble the whole time. Like, “Wow, so you were in the Beatles? Wow. Yeah. That’s great. So can you tell me like, what’s it like being a Beatle?” And that’s what I felt like the whole time, [LAUGHTER] like “Wow. Okay. All right.” So it took a while. But the grant helped it and for about three or four years it was grant funded. And now I’ve turned it into its own nonprofit. And Texthelp is now a sponsor. And so they do the editing for me because the grant ended. And Tanner, he was part of that grant. So i had to kind of move on. That’s how it started.

John: So you’ve been doing this for a while now with the podcast, and we’ve been listeners since the very beginning. What do you enjoy most about podcasting?

Lillian: Well, ours came out around the same time. So the nice Tea for Teaching, right? It’s like 2018. And so I enjoy talking to people. If you’re still doing it, you have to enjoy talking to people. But that’s the best thing. I talk to people just all around the world because I do want it to have a worldwide focus. And so I have listeners, the top five are in the US, Canada, Australia, Ireland, and the UK, and so English speaking countries, yay. But you can see like, all over the world on six continents that people are listening, and I had a listener in Australia say, you know, I was walking on the beach, near my home, on the coast of Australia. And that just blows my mind that people are actually listening. But mostly it’s like, I get to just learn about new ideas all the time. And you would think UDL like it’s so focused on UDL, like, there would not be enough, like I should be done with this, but there’s so much.There are 31 of these checkpoints in Universal Design for Learning, and as you mentioned, it’s really overwhelming. Like if you were to go and just look at the guidelines, it’s like a whole bunch. And it’s like, how am I going to do that? You can’t, you can’t do it all. You can’t just redesign your course right away. And so there’s just all these little conversations I can have to help people understand what you can do. And then I get to talk to really interesting, witty, awesome, brilliant people all over the world. And that’s the best part. If I could just do that, like that was just my job, I would love that.

Rebecca: Definitely something that John and I enjoy too. It’s kind of an introvert’s dream to talk to [LAUGHTER] a lot of individuals one on one rather than having to network through a conference or something like that. It’s a good opportunity to have really in-depth conversations with folks that might not have the opportunity to have otherwise.

Lillian: Yeah, my brain is always seeking out the new. And so I love like, “Oh, that’s a neat idea.” And then I’ll send them an email, and sometimes they write back, and “oh, I really love to talk about this, it’s cool.” And so I’ll read their article or their book or whatever. And then there’s something else shiny that I get to go talk to other people about. And it’s just been helpful for folks. And honestly, I just didn’t expect there’d be listeners, and there are listeners. And so that’s just really fantastic.

John: We started out as primarily to meet our campus audience needs for commuting faculty, and so forth. And then we were amazed at how it caught on and spread. And it’s given us that opportunity that you both mentioned, to talk to some really interesting people doing some really interesting work. Before that in the teaching center, we talked to people at a workshop, and we might hear from one faculty member for three or four minutes, maybe 10 or maybe they’d come in for a consultation. But usually that was about a problem or an issue they were facing, but it just provides a wonderful chance to connect to people that we normally wouldn’t be able to talk to. And we see an interesting article, and then reading through it and getting to talk to the people doing the research in depth, it’s really a valuable experience.

Lillian: Yeah, everybody should be a podcaster just to have these conversations. You don’t even have to record them. It’s just really neat. And so it’s given me that like, “Hey, I have a podcast,” like a reason for me to be intrusive in somebody’s email. Like, I really want to talk to you about this. This is really cool. Would you talk to little old me? If so I have a podcast. [LAUGHTER]

John: And I’m amazed at the number of people who say yes.

Lillian: Absolutely, me too, like, “Wow, you’re actually going to talk to me. That’s so fantastic. I appreciate that.”

Rebecca: We’re definitely a part of a really wonderful community of practitioners.

Lillian: Yeah, it makes a very thankful and it’s so cool, because I have listened to Tea for Teaching for a long time. That’s actually my most listened to podcast for teaching and learning. I enjoy the fact that there’s two of you, and you kind of go back and forth and just interesting topics. So I’ve enjoyed yours, ever since the birth of our podcasts in 2018. They’re siblings. [LAUGHTER]

Rebecca: They are.

John: So we always end with the question. What’s next?

Lillian: I am so excited about what Appalachian State is doing. About two years ago, they bought a building in a town called Hickory, North Carolina. And our main campus is in Boone. And it’s a beautiful campus up in the mountains. And I happen to live halfway between these two cities. And so I was going up to Boone to teach and it is about 42 minutes to get up. And you have to go over the eastern Continental Divide, over the Appalachian Trail, over the Blue Ridge Parkway in order to get from my house into Boone to teach. And that’s great. And it’s the most beautiful commute I think in the world. But it also gets foggy and icy and weather and I was enjoying it, and it was where I would listen to podcasts. But Appalachian State is now the first university in the North Carolina system that now has two campuses. And so we’ve opened this campus in Hickory, it is a commuter campus, and some brave students, we have about 250 to 300 that have started this past fall of 2023. It has birthed this campus. And so I get to teach there, and I get to do some faculty development. And it’s really exciting to be on the ground floor of a new campus. And it’s the only one in the North Carolina system. We’ll have other campuses, but there’s no multi-campus university for us. It’s like being in a startup, except I don’t think I get stock options. That’s the only bad thing. [LAUGHTER] And so meeting new faculty, some faculty are teaching for the very first time. And so there’s no like institutional culture that they’re jumping into at this new campus, although we are very much a part of the Boone campus. It’s new. And there’s only a very small number of faculty there. So it’s like being at a small liberal arts college in a state system. And it’s just really cool. And I’m loving meeting the faculty there and helping with teaching and learning and UDL and all that stuff. So that’s like the next big thing is Appstate Hickory, and it’s really exciting.

Rebecca: Well, I hope you have a wonderful adventure. [LAUGHTER] It sounds like a really fun opportunity.

Lillian: Yeah, in fact, I’m in a group of faculty, we have like a community of practice, a peer mentoring circle we call it, and we’re calling ourselves the Hickory Adventurers, because like, we don’t know what’s going on, [LAUGHTER] and we’re trying to figure it out together.

John: You get to help shape what’s going on, which is a really nice place to be.

Lillian: Yeah, it’s fantastic. I’m excited. And I think I’m just that kind of person. It’s new and shiny. And I’m there.

John: I think we’re both that way a bit. And that is one of the risks of having a podcast, you get to hear about all these great things that people are doing, and there’s always a tendency to try to do many of them. And that can be a bit overwhelming, not just for us, but also for our students.

Lillian: Yes I know I have to peel it back [LAUGHTER] just a bit, don’t go overboard.

Rebecca: Well, thanks so much for joining us, Lillian. I know we’ve wanted to talk to you for a while.

Lillian: Absolutely. I’m so glad and when you contacted me, I was super excited. So thank you so much for having me on Tea for Teaching. I’m gonna show my mug that nobody can see ‘cause it’s a podcast, but I love my Tea for Teaching mug, and thank you for having me.

John: Well, thank you for joining us. It was great talking to you and we’ll look forward to more conversations in the future.

Lillian: Great.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

325. Looking Forward to 2024

As we enter this spring semester, we take a break from our usual format to discuss what we are looking forward to in 2024.

Show Notes

Transcript

Rebecca: As we enter this spring semester, we thought we’d take a break from our usual format to discuss what we’re looking forward to in 2024.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: So what tea are you drinking now, Rebecca?

Rebecca: I’m drinking Ceylon tea.

John: And I have ginger peach black tea from the Republic of Tea.

Rebecca: So it’s a new year, John, and we’re gonna have a nice positive episode. So what are you grateful for?

John: I’m grateful that we survived another year. I’m grateful for the continued return to face-to-face instruction and a continuing return to a more normal classroom environment and college environment after all the disruptions from COVID that lasted for a while. And I’m also grateful for the initiatives that we’re using on our campus, and most campuses, to provide more focus on equity and trying to reduce some of the equity gaps that we’ve been seeing. And I’m seeing a general interest in that across a wide range of faculty and the administration. And we’re just in the process of running some workshops, and we’re getting some really good attendance at workshops that focus on techniques that faculty can use to improve equity and reduce some of those gaps. And I’m looking forward to seeing continued expansion of more equitable practices. And also, we’ve had quite a few people trying to implement the TILT approach that Mary-Ann Winklemes has talked about on a past podcast episode, and we’re hoping that that, combined with the increased structure that many people are trying to use in their classes, will help provide all students with more equitable outcomes.

Rebecca: I’m really glad that you have brought up equity, John, because I was just reflecting on a couple meetings that I was in just this week, and thinking about how equity oriented many of our colleagues are. And it’s really exciting to see them really advocating for policies, instructional practices, and many other things that are really equity oriented, and thinking about inclusion, and access, and all the things that you and I have talked about for a long time and have cared about and tried to implement in our classes. I’m also really grateful for, and I know you are too, for the many guests that we’ve had who’ve shared their expertise with us and with our audience. When we do these weekly episodes, it’s so great to have the opportunity to talk to such experts, to learn from them, to stay fresh with what’s going on, and to be able to share it with everyone else. It’s an experience that I didn’t know that I wanted, and I’m glad that we get to continue doing it.

John: And one other thing I’m grateful for from last fall is I attended my first POD conference, and I got to meet dozens of guests that we’ve talked to before. And we’ve talked to them, we’ve seen them on camera, but it was so nice to meet them and talk to them in more detail and in more depth in person.

Rebecca: I felt that way when I went to EDUCAUSE for the first time this year and connected with a number of colleagues focused on accessibility and growing that network and really connecting beyond just names and emails and other ways that we’ve communicated.

John: What are some of the major things you’re watching in the higher ed landscape? We’ve seen a lot of changes going on in the last few years, what are things that you’re going to be focusing more of your attention on in the next year?

Rebecca: I know that some of the things that we’re working on in grad studies and that I’m personally really involved in are kind of some increased accessibility resources for our colleagues at Oswego as well as SUNY. I’m looking forward to building out some of those resources, sharing those resources, and wrapping up a couple of research projects related to accessibility and getting to share those out. And I’m really excited that the higher ed landscape generally is having a lot more focus in this space because students with disabilities have been often overlooked in our diversity, equity, and inclusion initiatives. And there definitely is a push to be a little more inclusive, and to have that population represented in these efforts and initiatives. We’re also really focused on ideas of belonging for a wide range of students, thinking about how do we get our online students connected to each other and to the larger population of students and to see them as members of our community, extending some of those features and opportunities for international students and really thinking about what some of their needs are to be successful at our institution, especially with our kind of rural location, and what can make things really excited. So I’m really looking forward to finding ways to support our students not just in the courses that I’m teaching or in my instructional role, but also in policies and procedures that we’re implementing at the institution,in grad studies, but more broadly as well. How about you?

John: One of the things that I’m really following closely is the development of AI. This came about a little over a year ago and it’s been a really disruptive influence. It offers a lot of tremendous possibilities, but it also provides some challenges to traditional assessment, particularly in asynchronous online courses. So I’m looking forward to continued development, it seems like there’s new tools coming out almost every week. And it offers some really nice capabilities to narrow some of the equity gaps that we have by providing low-cost assistance for students who may not have come into our institutions quite as well prepared. It offers a possibility of students doing a little bit more retrieval practice for those classes where instructors are not providing those opportunities. It offers students who, again have a somewhat weaker background, to take more complex readings that they may have been assigned and simplifying it and creating a more accessible format to help students get up to the level they need in their classes. And so it provides tools that can help students improve their writing, and so forth. The challenge, of course, is that it can also be used as a substitute for learning in some classes unless assignments are designed in a way, and assessment techniques are designed in a way, that reduces the likelihood of that and that’s one of the things we’ll be working on a lot this year, ways of coming up with more authentic assessment and ways of providing more intrinsic motivation for the work that students are doing, so that students can see the value of the learning rather than focusing entirely on grades. And one of the things we’re doing is we have a reading group coming up early this semester on Grading for Growth by Robert Talbert and David Clark. And we’re, in general, encouraging faculty to at least consider the adoption of alternative grading systems, which shift the focus away from students trying to maximize grades to maximizing their learning. And there’s a wide variety of tools that could be used for that, ranging from mastery learning quizzing systems, which many faculty have already been doing through specifications grading, contract grading, labor-based grading, and also ungrading.

Rebecca: Yeah, it’s really exciting that we’re going to focus on that semester, something that I’ve been interested in for a long time and have been using in my classes as well. I’m glad you mentioned AI, there’s certainly a lot of promise, and I’ve been really excited by how many faculty, staff, administrators who’ve actually really been engaged in the conversation around AI. I think sometimes there are new innovations and things and people kind of brush it aside and don’t always think it applies to them or isn’t relevant to them. But I think this is something that’s relevant to everybody. And most people are seeing that and engaging in the conversation, struggling in the conversation, but at least we’re doing that in community. And I think there’s some power in that as we think through policy, in assignments and all the things that we need to think about to provide an enriching experience for our students, but also engage and use the tools and the power that they offer.

John: One other thing I’m following is the development of a wide variety of new edtech tools. We saw an explosive growth in the development of tools and expansion of their capabilities in response to the COVID pandemic, but that growth and expansion hasn’t dropped. And we’re seeing more and more tools that have often been designed based on research about how students learn. And I think we’re going to see expanded use of many of these tools in the coming year.

Rebecca: And I think a lot of faculty got used to experimenting with these tools during remote education and are continuing to use them in physical and virtual classrooms, which I think is really exciting, maybe even more exciting to me was attending big conferences like Middle States and actually having a presenter use some of these edtech tools as part of a plenary. So rather than having more of a lecture style session, it was more of an interactive session, which doesn’t always happen at conferences of such scale, or these more leadership conferences. So it’s exciting to see that we’re modeling some of these practices at the highest level so that the wide variety of individuals involved in higher ed are experiencing learning and engaging with these kinds of tools. Along the same lines, I’m also excited that many of these tools are starting to actually attend to accessibility, in part because higher ed institutions are really pushing back to third-party providers and requesting them provide information about accessibility, and even refusing to adopt tools if they aren’t meeting basic accessibility principles, which I think is really excited and really important.

John: And I saw something very similar both at the POD conference where you might expect to see people creating more interactive workshops, but I’ve also been seeing it in the workshops that we’ve had in the last couple of weeks here. We have a record number of faculty presenting in workshops, they’re using polling, they’re using tools like Mentimeter and they’re doing many more interactive activities than in past years. If we go back a few years, many of the sessions that were presented were essentially straight walkthroughs through PowerPoint slideshows with not a lot of interaction with the participants. And our workshops here have been both in person and remote over zoom. And people have been working really effectively to bring all the participants into the discussion and into the activities, regardless of whether they are in person in the room or remote. And it’s been nice to see that. Much of that I think did grow out of the experiences of COVID, and people just getting more comfortable trying new tools.

Rebecca: Come to find out, practice helps us learn things.

John: Also, our campus enabled the AI Companion in Zoom, which will provide meeting summaries for people who arrive late or people who come in at the end of a discussion. And I think that’s going to offer some nice opportunities for people who may have missed part of the discussion early on in a session, or in a workshop, or in a meeting, because so many of our meetings now take place over Zoom.

Rebecca: And there’s lots to be watching that are also highly concerning, but John and I resolved that we weren’t going to focus on those today.

John: So this will be a relatively short episode. [LAUGHTER]

Rebecca: So continuing on this theme of gratefulness and positivity, John, what are you looking forward to trying this year, or focusing on in your own work this year, or committing to this year?

John: One thing, and this partly follows up a couple of podcasts we’ve had in the last year or so. In our campus, many departments are working to build in some of the NACE competencies into their classroom. And there’s some really significant advantages for that. If it’s done well, it will help students recognize the intrinsic value of the things they’re learning in class and recognize that these are skills that they’re going to need later, which again, helps provide much more motivation for students to learn than if they just see a series of activities that instructors ask them to do, and they don’t see the value of that. So by making the connections between what we’re doing in the classroom in terms of the development of critical thinking skills, teamwork, and all those other NACE competencies, it offers some really serious benefits for students and for faculty. Because if students are more engaged in the activities and understand the purpose of them, I think they’re going to be much more likely to focus on the learning rather than again, trying just to get the highest grade. And that’s also very consistent with the TILT approach that we mentioned earlier. If students understand why you’re doing things, they’re going to receive the techniques and engage in them more productively than if they didn’t see the value of those tasks.

Rebecca: Yeah, I’m glad that you mentioned TILT as well. We mentioned it earlier, but I was just remembering that one of the things I wanted to mention while we were talking today is a commitment to thinking about TILT, not just in a classroom context, but all the other places that touch a student experience. So thinking about policies and procedures and ways that we can use a TILT approach to really improve transparency and clarity for our students and provide some equity and access by doing so. The other thing that I’m committed to trying to do is get back to more play, we’ve had some episodes on Tea for Teaching focused on play. And they always get me really excited about some of the things that I’ve done in the past in some of my classes and that I’ve done with some of my colleagues… and that the burden of transitioning during COVID to remote learning, some of these things have taken time and maybe attention away from play. And I’m hoping to take some time in 2024 to put some more attention back on being a little more playful.

John: So, you think education could be fun?

Rebecca: Maybe.

John: Okay. [LAUGHTER]

Rebecca: I’ve moved to doing some exercises and activities again a little more recently that get to some of these more playful ways of creating and making and thinking through complex problems. And every time I do that the students appreciate it. I have more fun, they have more fun, and I think a lot more learning gets done.

John: Since we want to focus on the positive, we’ll leave challenges for future episodes.

Rebecca: We’ve got all of 2024 to do that, John.

John: And we really appreciate, as Rebecca said, all of the wonderful guests that we’ve had since the beginning of this podcast, and we appreciate our audience too. So thank you for hanging in there with us.

Rebecca: Have a great 2024.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

324. Unmaking the Grade

A growing number of faculty have been experimenting with ungrading. In this episode, Emily Pitts Donahoe joins us to discuss her ungrading approach and the documentation of this process on her blog. Emily is the Associate Director of Instructional Support at the Center for Excellence in Teaching and Learning and Lecturer in the Department of Writing and Rhetoric at the University of Mississippi.

Show Notes

Transcript

John: A growing number of faculty have been experimenting with ungrading. In this episode, we discuss one instructor’s ungrading approach and her documentation of the process.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Emily Pitts Donahoe. Emily is the Associate Director of Instructional Support at the Center for Excellence in Teaching and Learning and Lecturer in the Department of Writing and Rhetoric at the University of Mississippi. She experimented with ungrading and chronicled her experiences in her Unmaking the Grade blog. Welcome, Emily.

Emily: Thanks. I’m really excited to be here.

John: We’re very pleased to be talking to you. We talked recently at the POD conference, and I’m looking forward to this additional conversation.

Emily: Yes, where I got this lovely tea for teaching mug from John, which I’m so excited about and drinking from right now.

John: And since this is only audio, Emily was holding the mug [LAUGHTER]…

Emily: I’m showing it off.

John: So our teas today are:… Emily, are you drinking tea in that mug?

Emily: I am. [LAUGHTER] I am drinking tea out of my tea for teaching mug. I’m a big tea drinker. And so today I’m drinking my favorite tea, which is a strong black tea called Scottish morn. And I got this tea from a tea shop called Apothica in Niles, Michigan, which I used to go to when I lived in South Bend, so highly recommended if you’re in that area.

Rebecca: Sounds wonderful. I was ready for you to say that you had coffee or something in the tea for teaching mug so it’d be completely blasphemous… [LAUGHTER]

Emily: Never.

Rebecca: …because coffee is one of the most frequent flavors. [LAUGHTER] Emily, you’re doing it right. [LAUGHTER] I have blue sapphire tea today.

John: And I have Irish Breakfast tea today.

Rebecca: So, we invited you here today, Emily, to discuss your experiences with ungrading. Your blog is based on your spring 2023 course experiences but your ungrading experience predates this course. Can you tell us a little bit about your initial experience with ungrading?

Emily: Sure. So I have a background in Writing and Rhetoric and English literature, and so a lot of what we do in Writing and Rhetoric, I think, is already pretty aligned with some ungrading goals and practices. So in my courses, students have always had the opportunity to revise their work based on feedback, and include it in a final portfolio, and most of their grade is based on their revised work. So it’s not just that they get graded and then that’s the end of it, they always have a chance to improve based on feedback. The first time that I stopped putting letter grades and percentages on student work was in spring of 2022, when I was teaching a general education literature course at Notre Dame, and so the course was on pre-modern and early modern literature, but with a focus on how the texts that we were studying might help us examine or wrangle with some of the questions that we’re preoccupied with as a culture and society today, and thinking about how those texts might relate to student lives. So it was a course for kind of all levels and all majors, which I think made it a good course to experiment with. So I had first-year students all the way up through senior-level students from engineering and business and English and psychology and all kinds of different majors. So like all teaching experiments, I think there were definitely some kinks to work out after that first course; they never go exactly right the first time. [LAUGHTER] But I would say that, overall, it was a huge success. And that’s not because I did it perfectly, or even because I did it particularly well, but because I think ungrading really helped some of my students move beyond this idea of the school as a points game, to help find their interest and their motivations to study the material that we were studying for their own purposes, and to focus on developing the skills and knowledge that they wanted to develop rather than on attaining a specific grade.

John: And the second time you did this, you created a blog describing the process. What prompted you to create the blog?

Emily: So, I was inspired by a post written by Robert Talbert, who’s the co-author of a recent book, Grading for Growth, which I really highly recommend on alternative grading, and he and David Clark, his co author, also had a blog and substack newsletter on Grading for Growth. And so in December of 2022, Robert posted a stop, start, continue for the ungrading community. And if you’re not familiar with stop, start, continue, it’s an evaluation exercise used for mid-semester reflection, very often in classrooms where the instructor or another facilitator will ask students: “What kinds of teaching practices or classroom practices would you like to stop, start, or continue in the class?” And so Robert’s post was a stop, start, continue for the ungrading community. And one of the things that he recommended that the ungrading community start doing was getting into the weeds and writing in detail about the daily experiences and specifics of upgrading, so: what we’re doing, what kind of successes we’re having, what challenges we’re encountering, how we’re adjusting in real time, and he recommended keeping this as the kind of blog or like a captain’s log of weekly reflections. So when I read his post, I thought, “Well, I could do that. It didn’t sound that hard, and it sounded like a lot of fun.” So that was what prompted me to start writing weekly reflections to share some of the methods that I was using, successes and challenges that I had, and even some of my doubts or misgivings about some of the things that I was doing in the class.

John: And just as an aside, we were so impressed by Grading for Growth, that we’ll be using it in the spring reading group here, both at SUNY Oswego and at Plattsburgh with Jessmyn Neuhaus. So we’re very much looking forward to that. And Robert and David will be giving a keynote address at the start of our workshop series in just a few weeks in early January. So we’re very interested in doing more of this on our campus as well.

Rebecca: Can you talk a little bit about your decision to delay posting the blog until after the semester ended?

Emily: Sure. So the selfish reason is that it’s supposed to be an unfiltered look at the ungraded classroom. And part of me thought, what if I messed this up so badly that I’ll be embarrassed to talk about it. So it was partly that, but I would say the more important reason is that I thought it might be weird for students if I was talking in public about what was happening in the classroom in real time. And I was concerned that it would damage the relationship of trust that I wanted to build with my students if they knew that I was reporting on our conversations to a larger audience about the class. So I offered to hold things for that reason. But the other thing that I wanted to do was make it clear to students that I was writing these reflections that might later be published, and then to get their input on them. So some of what I shared on the blog, I didn’t really want to share without getting students consent to do that. But I also wanted to get their input on some of the things that I was talking about. So I believe really strongly in taking a students as partners approach to higher education and learning experiences. And I try to employ that in my educational development work in the classroom. So that means bringing students into conversations about teaching and learning and asking for their experiences and their expertise as students really and then using that to inform our practice. So delaying the posting allowed me also to get some input from students and to be able to share some of their thoughts and opinions on the blog whenever I could.

John: In reading through your blog, your spring 2023 class seemed really interesting. Could you describe that for our listeners?

Emily: Yeah. So this is the second course in our sequence of first-year writing courses here at the University of Mississippi, but it’s a little bit different. So for the second course in the sequence, students have the opportunity to take either Writing 102 or Liberal Arts 102, and I was teaching Liberal Arts 102. And so the goals of each course are really the same. But Liberal 102, as we call it, is conducted within the context of a research area in a specific discipline. So that means that it can have a very specific theme. So some of my really excellent colleagues in the department and in other departments have taught courses like writing about true crime, or the rhetoric of sports, or I believe there’s a course on fashion. So because one of my areas of expertise is teaching and learning, the course that I taught was called Examining Higher Ed Teaching and Learning in a College Classroom. And so I think this is a great course for first-year students as they’re entering this next phase of their education to reflect on where they’ve been and where they want to go. And so what we did was looked at questions like: What’s the purpose of a college education? Why are we all here? What kind of benefits does it provide to individuals or to society? What kind of collective benefits does it provide? And then how are those benefits enacted or engendered in the classroom. And so we explored a lot of debates around higher ed in the US and students have an opportunity to reflect on and draw on their own experiences as students and their expertise as students, and then integrate that with larger areas of research on education or current events in education. And then they communicated their ideas about education to audiences outside of our classroom. And so it was really, I think, an ideal course for ungrading because we could talk about grades, not only as a matter of course policy, but also as a core subject matter. So in the beginning of the semester, we read Alfie Kohn’s piece “The Case Against Grades” and talked about it both as a way to introduce the course grading system and as a kind of larger prompt for reflection about grades as an issue of concern in higher education right now.

John: And it sounds like a great opportunity to have students reflect on what you’re doing as you’re doing it. How did students respond to this?

Emily: So I think every time I’ve ungraded a class now, and I’m currently on my third ungraded class, students have responded a little bit differently every time and of course, every individual student is also different. I think there are three broad categories of response that I see. One is just enthusiasm; some students are really excited about ungrading, and usually that’s students who feel that, for one reason or another, their grades in the past haven’t been representative of their learning or who feel that some of their creativity or their risk taking has been stifled by their desire to get a good grade. So I wouldn’t say this is a lot of students, this is probably a smaller group of students, but some students are really excited about it. I would say another group of students are really hesitant because ungrading is a big unknown for them, especially for students who are dead set on getting that “A” grade. It can be really nerve racking not to know kind of where you’re at in the middle of the semester. When I get negative feedback on ungrading, it’s almost always students who say,”This is really interesting, but I never know where I’m at.” And so they’re really concerned about how they’re going to measure their progress. But they’re not thinking about their progress in learning, they’re thinking about their progress toward a specific grade, which is really understandable because grades are important. And so that’s also a smaller group of students. But I would say, by far, the biggest reaction I get from students is something like cautious optimism. So I always start ungraded courses with a conversation about grades and learning, and I ask students to share with me their experiences of grades and share with each other. And very often, they have a lot of negative experiences to share, and sometimes positive experiences as well. But we talk about the relationship between grades and motivation and grades and learning and they have a chance to reflect on that. And so I use these conversations as a jumping off point to explain why I use the system that I do and how I think it will benefit them as learners. And I think students find it really helpful to be able to talk about their experiences with grading openly and to be heard by a teacher. And I think that that alone makes them more willing to buy into the system. So once it’s explained fully, and once students start to see the potential benefits, I would say that most of them are cautiously optimistic.

Rebecca: I think that largely aligns with my experiences and explorations when ungrading as well. In your class, you included five different assessments and opportunities for revision. Can you talk about and describe these assessments?

Emily: Sure. So the first thing that students had the opportunity to do were weekly writing practice assignments. So these are what you might think of as formative assessments, they’re preparation for class discussion and major assignments that mostly involve reading or short writing prompts. And these students weren’t able to revise, they either kind of did it or they didn’t. But then students had an opportunity to do more longer major assignments, which are more typical assessments for the writing class, a series of papers and a multimodal kind of project or two, with an imagined audience kind of outside our classroom. And so these students could revise up to three times if they wanted to do that. And so I had to, for this class, adjust a little bit and do slightly fewer assignments than I might have done in a traditionally graded class, because the expectation is that students would be doing more intense work on each assignment in their revision. I also asked students to do self assessments periodically throughout the semester. So students would answer a series of questions about their progress toward the learning goals, about their goals for the remainder of the semester. And they would also propose a current grade for themselves based on evidence that they provided. And this is a similar activity to what we did at the end of the semester to determine their course grades. They were also assessed on their final portfolio, which had revised versions of their major assignments. So their work… basically as good as they could make it… their best version of their major assignments, plus another final self assessment of their work in the class. And then they were also assessed on class engagement, so their class attendance, their preparation for and participation in class discussion, the timeliness of their work, their support for the learning community and fellow students and things like that.

Rebecca: Can you talk a little bit about how you provided your feedback on those assessments?

Emily: Sure. So for the writing practice assignments, usually I just wrote a sentence or two in response to students work to let them know if they were on the right track, or they may be needed to adjust slightly as they prepare for their major assignments. For the major assignments, I did do a lot of longer written feedback, and a lot of this looked like feedback that I would give in a traditionally graded class. But I think it was a little bit more oriented toward future growth, rather than reflecting on past work. It was giving them a lot of direction on how they might want to revise to make their work better in the future, not just for future papers, but for this particular paper. And with that feedback, I also gave them a rubric, where I marked kind of where I thought they were at along the specific assessment categories and criteria that we were using for that assignment. So for example, we might have a category for audience and purpose. Students could see whether I think their work on that category was still developing, whether it was at the level of proficient or whether it reached the level of excellent, so I had these different categories and these different kind of progress metrics, where I would indicate this is a skill that I think you’re still working on, or this is a skill that you’re doing really well in. And I also provided feedback to students through our individual conferences. So we met once at midterm, I met with each individual student, and then once at the end of the semester, to have a face-to-face conversation about how students were doing and if they needed to make any adjustments to reach their goals for the rest of the semester. And I didn’t give any feedback through letter grades or points. Those are not really great forms of feedback. They don’t actually give us a lot of information about our progress. So most of the feedback that I provided was kind of qualitative feedback.

Rebecca: You just talked a little bit about rubrics as part of a feedback that we were providing students, can you talk a little bit about how those rubrics were developed?

Emily: Yeah, so I’ve tried several different methods of creating rubrics. And one of the things that I like to do is co-create them with students or get students input on rubrics. And I attempted to co-create rubrics with students in two different classes and have done it a few times. And sometimes it’s a huge success, and sometimes it really does not work very well at all. And in my spring class, it didn’t work very well at all. [LAUGHTER] So basically, what I’ve done previously is ask students what they think makes a good argument or a good piece of public writing, or whatever it is that we’re working on. Or I ask them what kinds of things they believe their writing should be assessed on, and how we would determine whether or not their writing is successful. And then we have a conversation about that. I make notes on the board as we’re talking. And then I go away and distill those notes down into a rubric with about five categories in which student work is assessed. And then there’s the three metrics, so developing, proficient, and excellent. And sometimes this works really well. But in my spring class, I think the students were really at a loss when I asked them about assessment, and even when I asked them what good writing looks like. And I think that’s because that no one has ever asked them to think about that before. They’re used to being told what their work should look like by someone else, and then trying to conform their work to those expectations, or to someone else’s standards. And obviously, we need to have standards and expectations for student work. But one of the things that that does is get the students only thinking about what the teacher wants and not what they want. They’re not thinking about what they want their work to look like, or what their standards are or what they’re trying to accomplish. And so I think, ultimately, if we’re preparing students for the real world, whatever that is, this is what we want them to be able to do, not just to blindly follow somebody else’s standards, but to create and work independently in a self motivated way, and then assess their work independently. So I think we have to kind of start with baby steps in that process. So in the spring course, the rubric activity really turned into a conversation about how students have been assessed in the past and why they’ve been assessed that way. So when I ask them about their experiences, how their writing had been assessed, they would say things like, we were graded on the word count, or we were graded on whether or not we included two sources in every paragraph. And then we use that as a jumping off point to talk about the principle behind those what they viewed as arbitrary rules. And so if your teacher is concerned about word count, it’s because they want you to make a substantive argument. And what does a substantive argument look like? If your teacher is concerned about including sources, it’s because they want you to make an argument based on strong evidence. And so what would strong evidence look like? And so we use that conversation to think about the assessment criteria for their college level work, and how that might be similar or different from what they experienced in the past. So in that way, I do think that conversation was helpful. And I do think based on my few experiences, that it helps to have students extrapolate criteria from some examples, rather than from thin air, kind of as I was asking them to do, but either way, having a transparent conversation about what students are being assessed on and why and a purpose behind the criteria is key to their success.

John: In one of your blog posts, you describe some of the writing assignments that you used in your class, and they seem quite interesting. Could you describe some of the writing prompts that you gave to students?

Emily: Yes, I was really excited about some of the assignments that I developed for this class. And I think I’m going to keep using them or versions of them in future classes. So for this class, I had a menu of assignment options. So the students could, for each major assignment, choose the kinds of projects that they found most compelling, or they would really draw on your strengths. And I thought this was important, partially because we were working some with generative AI in the class. And I’m sure everyone is aware by now some very serious data privacy concerns, ethical concerns around the use of generative AI. So I didn’t want to mandate that students work with AI if they didn’t want to, and some really didn’t want to. So I tried to offer them several options. And I was really happy about some of the options that I came up with. So obviously, one of the things that I was thinking about going into this semester was how to deal with generative AI and I have a lot of thoughts about that. But one big way to think about how to discourage inappropriate use of AI or encourage appropriate use of it is to think really carefully about assignment design. So one of the things that I did to help students navigate AI was lean into some multimodal work, think about argumentation in media other than writing or that kind of worked alongside writing. So we didn’t abandon writing entirely, but I did include a photo essay as one possible assignment in a menu of options. And for this course, I asked students to take a look at a book of photographs by Cassandra Horii and Martin Springborg that’s called What Teaching Looks Like. It’s a really, really cool book with candid photos of college teaching. And so we use this book to talk about visual rhetoric and also to use the photos as a launchpad for this discussion about college teaching practices and students’ experiences in the classroom. And so the assignment that students did based on their work with this book was to create their own photo essay called “What Learning Looks Like.” So instead of what teaching looks like, what learning looks like, with a specific audience and purpose in mind. So that was one of the assignments that I liked. Another one that I thought was really promising was something called “share your story,” which asks students to tell a personal narrative about their educational experience, and then connect that to a larger issue of concern or a body of research in higher education. So of course, this is not totally AI proof. ChatGPT can make up a story, but it can’t tell my students’ own stories. And I think most of us really like to tell our stories to other people. So I think that provided a little more motivation for students to do their own work. And then the last assignment that I really liked was an assignment that actually asked students to work with ChatGPT. So they created a prompt based on a template that I provided for an argumentative piece that they then fed to ChatGPT, so they gave ChatGBT the prompt. And then they took the ChatGPT output and critiqued it. So they annotated it, noting what pieces they thought were strong, whether or not the piece had weaknesses, and what those weaknesses were, where it might need revision or overhaul. And then they had to totally rewrite the piece that ChatGPT produced and make it their own. So they had to do a substantial revision. And then they had to annotate their own work and tell me why they made the revision decisions that they did. And so I want to clarify that I do think it’s important that students learn to generate first drafts on their own, because drafting is an essential part of the writing process, and it’s where a lot of the thinking happens. But I like this assignment as just one assignment in the sequence, because it does help students learn about generative AI and develop some AI literacy. And it also helps students get over that terror of the blank page. So a lot of students procrastinate because they don’t know how to get started. They’ll open their laptop to begin a paper and stare at the blank screen. And I find it really difficult to get over that first hump of starting work, and just close their laptop and go away and try it again later, usually the night before it’s due. So I think starting in this way, with a ChatGPT prompt and an essay gives them a jumping off point, and it’s an easy way to help them start building the confidence they need to do their own first draft.

John: We should mention that we did talk to the authors of What Teaching Looks Like, and we’ll include a link to that discussion in the show notes. One of the things you described in your blog is that having this ungraded environment encourages students to be perhaps a little more open and honest with their instructors, but that could lead to some challenges in terms of additional emotional labor. Could you describe the challenges that you faced in this class with that?

Emily: I think one of the big themes in the spring class in particular was that I asked students to share with the class and for audiences beyond the class about their previous experiences in school, or their current experiences, and I think this also happens in a lot of ungraded classes. One common method of introducing an unfamiliar grading system is getting students to think about their previous experiences with grades. And so one thing that happened in this particular class is that students’ related a lot of past educational trauma to me, and usually that involves bad experiences with previous teachers. And I’m really glad that they were able to speak honestly about that sort of thing. And I think it helped them to have a teacher take them seriously when they related those stories. At the same time, it was pretty difficult to navigate those conversations, because I was managing their emotions, my emotions, and also doing that when sometimes I only knew one side of the story. And so that was a little bit difficult. Another thing is that students in this class didn’t seem to feel that their grade depended on telling me what I wanted to hear. So I think they were a lot more honest about their views than in other courses that I’ve taught. So in my traditionally graded classes, or I think, in any class where students are discussing hot button issues, they tend to think that they’ll be graded more harshly if they express views that the instructor disagrees with. So very often, I think, they try to say what they think you want to hear rather than what they really think. And that didn’t seem to happen as much in my spring course. I had several students endorse viewpoints that I definitely disagreed with whether they knew that or not. And I think that’s good, because students have to sort through their own views and values. But it also required me to do a lot of thinking about how I would approach and address students not just whose views I disagreed with, but whose expression of those views might be damaging to others or to themselves. And so, we need to do some work around community building and relationship building in the class. And then of course, when you build relationships with trust with students, they’re more likely to tell you about the personal problems that they’re facing, whether that’s their mental or physical health or their personal relationships or family emergencies or grieving. And it’s really just a lot. And I do sometimes lay awake at night worried about my students. And there’s a lot of care work happens, I think, in all classes and also especially ungraded classes. And so there’s a lot of work in referring students to other resources and helping them navigate campus resources, and also just a lot of kind of management of your own emotional state [LAUGHTER] that has to happen. So I did want to be honest on the blog about some of the emotional toll of the work of teaching in general and of ungrading too.

Rebecca: You’ve described the care work, you’ve described individual conferences with students, you’ve described students’ anxiety over not knowing where they are sometimes and allowing substantial revision. Can you talk a little bit about how all of those things play into workload and how you’ve managed things?

Emily: Yes, this is a good question. And I feel like I have a very complicated answer to whether or not ungrading has increased my workload, because I get asked this question a lot. In my traditionally graded classes, giving all that feedback felt like a waste of time for a few reasons. First, because I had the sense that students weren’t really reading the feedback. So we know from research that when students receive a letter grade and also feedback on their work, they tend to see the grade and then ignore the feedback, or at least receive the feedback as a justification for a grade, rather than something that’s going to help them improve their work in the future. So I also spend a lot of time in traditionally graded classes worrying about how students would receive my feedback if they got a low grade on their paper. So how could I write feedback that would be appropriately honest, but also appropriately encouraging, so that students didn’t just see a C-minus or a D on their paper, and then give up and throw it in the trash. So I don’t really worry about those things since I’ve adopted ungrading. I provide feedback honestly, and with the mindset of a coach rather than a judge. And I provide it with at least some confidence that students will read it and use it. So they have plenty of opportunity to revise. And in fact, their ultimate achievement of the course is measured by their growth in specific areas and their demonstration of learning that arises from taking a piece of writing from not so good to much better. And so the expectation is that what they turn in the first time is not their best work and they’ll only get to their best work after they incorporate feedback. So I do spend a lot of time responding to student work now that I’m ungrading. But the process is more efficient because it accomplishes my goals rather than wasting my time. And it’s more enjoyable, because it causes me less angst. So I guess it is more work to provide feedback, but it’s also more efficient and enjoyable work. I think I feel kind of the same way about individual conferences with students, that it does take quite a bit of time to do those and it would be, I want to acknowledge, so much more difficult, it may be impossible to do if I was teaching more classes and more students. I’m very lucky that I teach small class sizes. And because I work in educational developments and work in a teaching center for most of the time, I only teach one course at a time. So I think there are ways to do this with larger courses, but I’m very fortunate in my course to be able to conference individually with each student twice in the semester. And those conferences are incredibly time consuming, and they can be really draining, but they are also really joyful. And I think it’s really important that students are able to have those one-on-one conversations with me. And they are much more, I think, effective in accomplishing a lot of the goals that I have for student learning than just simply doing written feedback or peer review or things like that. Having that face-to-face time to give students some individual attention is a really both enjoyable and effective part of the learning process.

John: A question that often comes up from people who have not tried ungrading is how well do students’ perceptions of their learning align with your perceptions of the learning when you do have to assign those midterm or final grades in the class?

Emily: Yeah, this is a really good question. And I would say I’ve had to do a little bit of work on my process to make sure that our expectations are aligning well. Sometimes, there are cases where students don’t automatically start off knowing what I expect from their work and what good work looks like, even when I thought that I was clear about that. So that is an issue that I’m working on. I would say for the majority of students, they do understand what good work looks like. And when they’re asked to provide evidence for their course grade, most of the time they know what good evidence looks like and are able to demonstrate to me in really, sometimes ways that I hadn’t anticipated, that they really had learned in the class and progressed and improved their work. For those students who struggle, and I think it’s more frequent for first-year students to struggle with this than more advanced students, for students who do struggle, I think it is important to be able to show them models of student work early in the semester so that they can get a sense of what a successful assignment looks like or what’s kind of level of expectations we have for what student work counts as really excellent work. So that’s been really helpful. And I’ve also made some changes to my class this semester to help clarify for students a little bit what kind of evidence might be good evidence for specific grade proposals in the course. So if they are really shooting for an A or B in the course, what kinds of actions or behaviors or demonstrations of quality work do they need to be able to show in order to attain that grade?

Rebecca: I know one of the things that I struggled with in some of the classes where I’ve done ungrading is that sometimes the midterm conference feels like it comes too late. So I experimented, I think once with like a one-third, two-thirds, three thirds approach, but then that was so much more conferencing.

Emily: Yeah.

Rebecca: So I’m curious about your timing and how the midterm time works in the classes that you’ve been teaching.

Emily: Yeah, I think that’s where the self-assessment assignments come in. So I do think midterm is quite late for students to be getting the first level of feedback. And so I have students do a self-assessment form, I guess, a quarter way into the semester. So we start that process really early of having them look back at the work that they’ve done, and propose a grade for themselves based on that work. And when they do those self assessments, I don’t conference with students every time they do a self assessment, but I do look at where their grade proposals are. And I’m able to say if our expectations are very, very different, or assessments of that students work is very, very different, I’m able to reach out and say, “Hey, I don’t think we’re aligned here, and here’s why.” And being able to intervene early on that I think is really important.

John: We’re recording this near the end of the fall semester of 2023. And you’re currently teaching another ungraded class, could you tell us a little bit about what types of changes you made from the spring class to the fall class?

Emily: Sure, there are a few changes that I’ve made, because there were some things that I think did not go very well in the spring and I wanted to try to improve that. So what didn’t go well was that I had a real problem with attendance, there were quite a few students who struggled with their attendance, especially in the latter half of the semester, and quite a few students who struggled to submit their work on time kind of throughout the semester. And that made it difficult for me, but I think more importantly, it made it really difficult for the students who once they missed an assignment, they found it really difficult to get back on track. So my challenge is really to figure out how to motivate students to attend class regularly and submit work on time without penalizing them for absences or late work or without a kind of point system to encourage them to show up to class and to submit their work on time. So that was one thing I wanted to address. And then the other thing is that students’ anxiety about not knowing where they stand in the midst of the semester at any given point. So what I developed to address all of those challenges was a course progress tracker. And so this is a document, a pretty comprehensive document, inspired by David Clark’s Grading for Growth post about grade trackers that I read during the summer while I was designing this course. And so the document is really a series of tracking worksheets in three different categories. So the first category is readings and assignments, students can see each week at a glance what work they have to complete, and then they can check off boxes as they complete that work, and then note, if there are assignments they’re submitting late, they can record those late submissions. There’s a category for attendance and engagement where students can check off the classes that they attend, and then make notes about their in or out of class engagement during each week of the semester. And then there’s a section… the most important section… for learning and growth where students can remind themselves of what the course goals are, and then track their progress along those goals, so they can see and make notes about where they’re still developing, where they’re doing excellent work, and how they’re improving their writing as the semester goes along. So, so far, it’s been going really well. And I’ve had fewer challenges with attendance and late work this semester than last semester, though, I can’t say to what extent that’s just a result of a different population of students or the fact that it’s fall instead of spring. So I will add that caveat, but I have surveyed students about their use of the progress tracker last week, and I’m really looking forward to diving into that next week. So the last thing that I think the progress tracker does, which I didn’t totally intend, but which has been really excellent, is that I think it helps students a lot with their self-assessment work, which they also struggled with, to some extent last semester, or I should say, maybe I struggled to teach really well. So I had a realization at the end of last semester, that when I sat down to think about a student’s work over the course of this semester, I was really thinking about three things. And so the first thing is quantity. How much work did students do? How much labor did they put in? How many assignments did they submit at a satisfactory level? How many class days did they attend? How much time did they spend on their major assignments? So that was one category. The second was quality. So how good was the work that they were doing according to the standards that we laid out? Was it still kind of developing work? Or was it excellent work? And then the third thing was growth. So how and how much did student work improve over the course of this semester? And can they demonstrate that they’ve gained knowledge and skills that they didn’t have before? Or can they demonstrate that they’re better off from having taken the course. And so while we’ve had conversations about those things in the spring, I never articulated to myself or to my students, that particular model; I never kind of said it in quite this way. So the last section of the progress tracker includes a guide to determining final letter grades for students. And it gives them space to think about quantity, quality and growth, and how that might contribute to the grade that they propose for themselves, if they’re interested in the specific letter grade. And it gives them a sense of what kinds of evidence they could provide if they want to show good evidence for a specific letter grade. So you can provide good evidence for an A if your work rises to the level of excellent on multiple assessment categories. Or if you attended class every time that you were able and submitted the vast majority of your writing practice assignments. So all of these things are good pieces of evidence if you want to propose an A grade for yourself. So there’s some flexibility there, I don’t prescribe exactly what students have to do for a specific grade, but I do make suggestions and say, here’s a guideline for you. If you’re confused about what kinds of work you need to be doing, or what you need to do to demonstrate that you’ve attained a certain letter grade, you can take a look at this guide, and learn a little bit more about what the expectations are. Currently, it’s just something for the students to use for themselves. I have provided time in class for students to fill out sections of it, because I think that if I did not ask them to do it in class, they might struggle to keep up with it outside of class. But I think maybe in the future, I will consider asking them to keep up with it. And then periodically checking in on those progress trackers throughout the semester so that I can intervene early, if there are any issues and maybe leave comments on the documents to let students know if I think they’re struggling in a specific area, or if they’re doing really well in a specific area. I am playing around with that idea for my next version of the class.

John: So we always end with the question: “What’s next?”

Emily: So this spring, I won’t be teaching an undergraduate course, but I will be working with graduate students who are preparing to teach their own Writing and Rhetoric courses. And I’m really looking forward to talking with them about teaching. And I’ll also be continuing to write about ungrading on the blog. So specifically, I’m hoping to share a bit more about what I learned from my experiences this semester. And I’ve been collecting data from my current students about their use of the progress tracker, about their use of AI in their writing this semester, and about their feelings and impressions of ungrading. And what I’m planning to do throughout the spring is share some of those student thoughts with the readers of the blog, and I’m really excited to be able to share students’ ideas about ungrading and other topics as well.

Rebecca: Sounds great. We’ll look forward to reading that for sure.

John: Thank you, Emily. It’s great talking to you and we look forward to future conversations.

Emily: Thanks, this has been fantastic.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

323. Explore First Study Abroad Program

Compared to continuing-generation students, first-gen students experience a higher risk of not completing a college degree. In this episode, Sue Roberts, Marianne Young, and Beth Hanneman join us discuss a study-abroad program for first-gen students that is designed to build their confidence, sense of belonging, and help them understand the connection between their education and their career goals. Sue is the Associate Provost for Internationalization at the University of Kentucky. Marianne is the Assistant Vice President for Smart Campus Initiatives at the University of Kentucky. And Beth Hanneman is the Associate Director of Career Advising and Career Education, also at the University of Kentucky.

Show Notes

Transcript

John: Compared to continuing-generation students, first-gen students experience a higher risk of not completing a college degree. In this episode, we discuss a study abroad program for first-gen students that is designed to build their confidence, sense of belonging, and help them understand the connection between their education and their career goals.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are Sue Roberts, Marianne Young, and Beth Hanneman. Sue is the Associate Provost for Internationalization at the University of Kentucky. Marianne is the Assistant Vice President for Smart Campus Initiatives at the University of Kentucky. And Beth Hanneman is the Associate Director of Career Advising and Career Education, also at the University of Kentucky. Welcome, Sue, Marianne, and Beth.

Sue: Thank you, we’re glad to be here.

Rebecca: Today’s teas are:… Sue, are you drinking any tea?

Sue: I am not drinking tea right now. But if I were in my normal space, I would be drinking tea. Yes.

Rebecca: Do you have a favorite kind?

Sue: I do. It’s a rooibos tea, a red bush tea.

Rebecca: Wonderful. Marianme, how about you?

Marianne: I’m not currently drinking too, but I have one on the ready. It is a lovely wild sweet orange.

Rebecca: Nice. What about you Beth?

Beth: So I went to Montana this past summer for a yoga retreat and fell in love with Huckleberry. So I now drink a wild Huckleberry tea at least once a week. And that’s what I’m having this morning.

Rebecca: I have never had that. I think it’s a first on the podcast.

John: It is. I am drinking an Irish Breakfast tea.

Rebecca: And I have a Jasmine Dragon Pearl this morning.

John: Dragon pearls?

Rebecca: Dragon pearls. [LAUGHTER]

John: Ok, so we have a mythical tea. [LAUGHTER] We read about the Explore First Study Abroad program in an article in the Chronicle recently. And so we invited you here to talk about that. Could you give us an overview of this program?

Sue: Sure. It’s a new program for the University of Kentucky, run for the first time in summer 2023. We took 60 students, 60 undergraduate students, all of them first-generation students to either London or Dublin for a three- week Education Abroad program focused on career readiness.

Rebecca: Can you talk a little bit about this program came about?

Sue: It came about in many different ways, actually. There were conversations happening on our campus for probably two or three years before COVID, even, among different colleagues, some in the Career Center wondering how they could produce really good career readiness, education abroad programming. So I’m in the office of first-generation student success thinking about how we could do a better job in introducing first-generation students to education abroad. And then in the International Center, in the Education Abroad office itself, there were lots of conversations about how we could partner with colleagues across campus to develop programs that would reach this demographic.

John: One of the things we were really intrigued about was a program that was designed to benefit first-gen students as well as providing those career readiness skills. Could you describe a little bit how this program integrates that career focus?

Beth: Yeah, I’ll take that one. So over in the Career Center, we have the national association called NACE and they have NACE Competencies. And so when you start thinking about any major that a student has, you want them to make sure that they have those skill sets. So when they actually get into the workforce, they’re able to be analytical, they’re able to have communication skills. And what I love about the first-gen program and Explore fFrst within that, is the idea of how do you do that in a global setting. And so when you start thinking about designing this curriculum, and me and Marianne had the privilege of helping to work on that. It was this idea of, we had at least find out what the foundation is that the students had. And so sort of thinking about block scheduling, where a lot of times professors may say we’re going to do one topic and then go to another, I did more of what we call spiral curriculum, where you introduce a topic, and we brought it in here in the United States before we left, so maybe it was resumes where they had to create a resume and work on a resume ahead of time. And then when we’re overseas, we re-introduced resumes to say, “How would you put this Explore First experience on your actual resume? …kind of the same when it came to networking. What does it look like to navigate, to connect with people? Okay, great. We do that here in the United States. But then how do you do that in a global setting. So it was one of those things where you can actually see that reinforced. I also thought that was really cool when it came to interviewing as well, of having that prep for the students within that area.

Rebecca: We have a couple of other episodes of tea for teaching that also talk about the NACE competencies that we’ll link in our show notes for folks that are interested in that particular detail. So we just talked about NACE. Can you talk a little bit about the benefits that students get from it being a study abroad experience?

Beth: Yeah, at least for myself, the world is definitely interconnected. And so what I loved about how we interacted with employers is that we first looked at those that were connected here to Kentucky, and then we reached out with those that would be overseas. So for example, we have a company named Alltech that’s located here in Lexington. And so our students on the Dublin trip was able to actually go see their location. So it wasn’t one of those things that “Oh, hey, we’re just randomly seeing a company.” We’re very methodical about how that connection is. Another company, Compass, for example, does food services for our University of Kentucky health care system. So it wasn’t one of those things of just like, “Oh, we’re just gonna go see a company.” It was one of those elements of not only is making this connection abroad, but how does this actually impact me back home. And we would actually talk about that. Students would be like, “Alright, yes, you see this in another country, how does cultural awareness make a difference? How does being able to navigate and learn about yourself influence who you’re going to be back at UK?” And one of my favorite questions we asked in the interviews that they had to do for one of the assignments was: “If you’re back on the college campus, and you run into the university president, what are two things you tell them about the program?” And it was really cool to hear from the students that like, “I didn’t think I could learn so much about myself in three weeks, let alone three months about a career,” and others have never been on a plane before to navigate what that looks like. So even if you go into the job market, most likely somewhere along the line, you’re probably going to have to travel somewhere and do connections, but to have that support to have other people with them, when they did it for the first time was really impactful.

Rebecca: I love that reflection question. [LAUGHTER] So many benefits to that.

Marianne: I think the global stage also provides a really unique opportunity to just boost confidence with these students, as Beth was talking about, some of our students had never been on a plane. And not only did they navigate getting on a plane, they navigated getting into and past customs and immigration and all of that. And then the most surprising piece to me, in terms of what this looked like in terms of that confidence boost is at the beginning of our core sessions with the students, they put together kind of a: “these are what my goals are currently.” And by the end of the program, not only physically the confidence that you saw as they stood in front of the class, and they were presenting what their new goals were, for some of the students it expanded the opportunities that they were considering. They had never considered what it might be like to be in a leadership position in a global organization, or for the other students, it solidified what it was that they were wanting to do. And that confidence that they had of “Yes, I’m on the right path,” I think came from them navigating situations that they hadn’t been in before. And then being able to connect with different companies and different leadership individuals within the company, who they could see like, “Oh, my gosh, they were first generation as well, and now they’ve moved abroad, and they have this position in the company,” and the confidence that came from being able to navigate an international city as well as “I have confidence in how I’m going to navigate my career pathway,” that was so amazing to see in the sestudents.

Sue: I will agree with that. I visited, I think, three of the four programs. The program was split into four different groups, two went to Dublin two to London. So there were 15 students in each and I think I’ve visited three of them over the course of the summer, and to see that confidence grow, almost hourly, was incredible. And I will say that I think it translates, we’re hoping anyway, that it will translate, into greater understanding and kind of sense of purpose as a student. So you can see the point of your degree, you can see the point of why you’re struggling through this or that course to make it through to graduation. And of course, we want to see good results in terms of retention rates and graduation rates.

Rebecca: I’ve had the opportunity to teach a couple of travel courses where I’ve had students who had never traveled before, some within the US and some travel abroad. And I agree that seeing the confidence growth in students is such a rewarding experience for the instructors as well as for the students. It’s a really powerful experience. But one of the things that I really love that you’re describing is this connection to alumni, and those really specific intentional connections between the businesses locally as well as abroad. That’s a really beautiful component of your program.

John: And one of the challenges that all colleges face is the relatively high DFW rates generally experienced by first-gen students. And by making clear to the students the salience and the relevance of the material that they’re learning, and how this can open up these possibilities to them in a very obvious manner that they may not naturally see, I can imagine this could be really transformative.

Marianne: I think one of the great moments we had as we were visiting one of our employer partners, as Beth was talking about the spiral curriculum, he had talked about LinkedIn profiles and been helping them and then we get to this employer visit. And they start talking about LinkedIn profiles. And it is almost the exact lecture we had given that morning. And students are turning around and saying, “Oh, my gosh, you told us that this morning, and here’s this employer saying this exact same stuff. You were right.” And so we revisited again, and then the next employer, and so it was the aha moment of “Oh my gosh, this is actually something that I’m going to need and I’m going to use as I navigate my career.”

Rebecca: Can you talk a little bit about what a typical day for a student looks like in this program.

Marianne: There was no typical day, but this will kind of give you some activities they may have been shuffled around a bit. We’d start off with maybe some class time reviewing the visit. Maybe we’d have the day before talking about the experiences that the students had, answering any questions they may have had, how they navigated a challenge, just really taking time to connect and then help them build on the information that we were presenting. Once we kind of move through class time, we might have visited an employer in the afternoon and done a site visit where we not only learned about the company but also some of our employers took us through exercises like design thinking at some of our tech companies, or walking us through interviews and resume reviews in terms of a mock opportunity if you’re applying to their company. And then we may also have a cultural visit in the afternoon, visiting a significant landmark in the area or learning about the history and the culture of the particular space that the students were in. And then in the evenings, our students would maybe get together and cook in the residence hall, or they might go out to dinner together. And so generally we had class time and some cultural visits or an employer visit.

Beth: Yeah, exactly what Marianne said, and when you think about over the three weeks, because we were there for three weeks with these students, the beginning part of the classes were more kind of prep and foundation to get them to know what to expect. And so we broke teams of three, and so we would have one person would be the person who was in charge of introducing the group, we had one person that was the photographer, one person that was in charge of the “Thank you” at the end for each site visit. And that was really cool to see him learn collaboration, but also kind of change up and like, “Oh, well, this person is really interested in architecture, so we’re gonna have him be the speaker for this one, and then I’ll do the photography. And this one over here, we as a group, we actually wrote the thank you note together of what that means to follow up within it, kind of expectations within it.” So that was really cool in terms of curriculum, and kind of how we set that beginning. And then closer to the end like Marianne said, was more like review: “What did you learn from it and reflection?”

John: Do students travel with faculty or staff from the University of Kentucky?

Sue: We structured this program so that each group of students was accompanied and led by two professional staff members from the campus. Typically, it was a person from the Career Center, and a person from the Office of First-Generation Student Support. So it gave the students oftentimes very familiar people who understood where they’re coming from, and the skills they brought to the table, but also a person with the career advice ready for them kind of as needed. So it worked really well, I think, to have those program leaders on the ground with the students. And we weren’t hosted by a university, although we did visit universities in both locations. But we worked with a education abroad partner provider called AIFS. And they have provided the classrooms, they assisted us find student accommodation, and they worked on us with the cultural visits.

Rebecca: I think I remember also reading that you did some work prior to going abroad and some coursework there. Can you talk a little bit about what that looked like?

Marianne: We had an opportunity and clusters with the students, we broke them into smaller groups to help prepare them for what to expect as they were preparing for their education abroad experience. And so we covered a variety of topics of what about your luggage? What is a carry on? What is it checked bag? How do you move through security? What can you expect in an airport? What can you expect in terms of customs and immigration? We talked about how to prepare for the weather, how to think about budgeting, and being prepared for different costs of things, or how you might be able to consider all of the different pieces and parts of preparing for souvenirs that you want to get… all those different things, a variety of cluster topics to make sure that our students not only had a connection with the person that they were going to be traveling with, but also the other students. And then it gave us space for any of the questions that students may have had, as they were preparing for this experience.

Beth: It’s just a great way, because a lot of times when I’ve done education abroad, you might meet at the airport for the first time. But what I loved about this program is that we literally got to know each other prior, to at least kind of understand maybe some of the things that they were concerned about as a student. And so then as a staff member, we can be like, “Okay, let me give you some extra resources.” I remember one particular student, I ended up calling her mom and her was on the phone, because she’s like, “Okay, Beth, I know you went through the whole situation of what we need to do for the airport, but my mom has questions.” And I was like, “Sure, no problem. Let’s talk.” And so her mom was like, “Oh, nice to meet you Beth. Her mom dropped her off at the airport, gave me the biggest hug. When her mom picked us up. She was like giving everybody in the group a hug, because we were extended family for them for three weeks.

Rebecca: Can you talk a little bit about the timing of the program?

Sue: So last year, it was the first time through, so I think we had to do things very quickly. We had to assemble a team, we had to get these clusters stood up. We had to recruit students, we had to find the scholarships for them and all the rest of it in kind of a hurry. So this year, we’re spacing it out a bit more. So we’re recruiting for summer 24 right now. And we’re going to repeat the program, we’re going to take 30 students in two groups to London and 30 to Dublin in two groups. So we’re excited about that. And then their travel occurs during the summer vacation, early in the summer vacation, so May and June this year.

Marianne: The interesting piece of the timing as well was I was on the first group that went to Dublin, and we were actually able to connect with the group that was coming after us in the airport as they were preparing to go out, so my students were able to pass along some words of wisdom and some thoughts to the group that was coming after them. And so that was a really fun piece with the timing to be able to catch up with each other in the airport.

Beth: In terms of curriculum, the way it was set up, there was one class that everybody was part of. So we actually met as a group virtually, with all 60 students ahead time. So everyone had that basic foundation. And then when we’re actually over there, that was when we did the actual classes for the individual pieces. So I did Dublin two and London one. And so at the same time, we’re having curriculum in terms of giving feedback for the next group coming over.

John: Now, you mentioned that there was some time spent acquiring funding, could you talk a little bit about the funding that was used for this program?

Sue: Sure. And this is a little unusual, I think. It was a surprise to us when the Kentucky State legislature or general assembly awarded some funding to all Kentucky institutions of higher education to support displaced students, so refugee students primarily. As part of that program, they allocated a certain amount of funding also to support education abroad and exchanges. So when we realized that, which was only in the summer before, so summer 22, we thought, “Aha, we could finally make this happen. This thing we’ve all been talking about in different ways about connecting careers, connecting first-generation students with education abroad, and making a real difference for those students, and we could do it at a actually a quite a big scale for education abroad, 60 students is quite significant.” So we seized the opportunity. The trick, then, of course, was to find matching money, because it didn’t cover everything. So we found some money internally at the university, we used education abroad scholarships, our administration at the very highest levels awarded us some funding to kind of back us up if we needed it. So it was a team effort. And this upcoming year, we don’t have the state money. That was a one time deal, so we’re funding it all from our university funds.

Rebecca: So cost is always a concern, I think, for first-gen students, and may be one of the reasons why they don’t even think they might ever go abroad. I know that was the case for me, as a student. I didn’t think I was ever going to get a chance to go abroad, but I got to when I was in graduate school. So can you talk a little bit about what this meant to the first-gen students or if you had trouble initially even getting them to think that they could really actually participate in this program?

Beth: Yes, one of our students on Dublin two got the email about applying and that the program was going to be there when we started doing the recruitment. And he was like, “Is this a scam? Is this true?” We went over to the first-gen office to verify because he’s like, “it sounded too good to be true.” And so once we got the word out that it was, of course, students applied and said, “Okay, let’s do this.”

Sue: You’re absolutely right that it’s the number one barrier of first-generation students is finances. And I think it was the majority of our students on this program are Pell recipients. So first-gen is a very big category. But we did try and make a difference, particularly for students whose financial means were limited. So it was a tremendous opportunity for them. And as Beth said, some of them were very disbelieving at first of the opportunity, they couldn’t understand how this was happening, because they hadn’t thought that this was something that they could ever achieve. And that was another reason why we kept it to three weeks, because many of these students… well, in fact, I would say all of them… were working during the summer. So three weeks away from your summer job and earning is a big deal, and others had family obligations as caregivers, and so on. So that’s the reason why we ended up with a three-week timeframe was partly to be sensitive to those needs. And then in terms of the financing, London is an expensive city, and Dublin is an expensive city. And these are young people, these are primarily first- and second-year university undergraduates. So budgeting to shop, to eat, to go out is difficult, and especially when it’s a different currency and options are different, and the prices are different. So that was a big element that we’ve reflected on since this first time through, and I think we’ll be maybe just a little bit more supportive. We were supportive, but maybe just a little bit more supportive of how to budget when overseas because they were responsible for their own spending money on this program.

Rebecca: What about things like food or other personal costs for travel, was that included in the program?

Sue: So there were a few meals included. There were a few like welcome dinners and things like that included, but by and large students were responsible for their own catering as it were for their own food. And it turned out that was kind of an issue because it takes a bit of knowledge of the stores and what’s available and what’s affordable. It takes a bit of knowledge of how to cook in a budget conscious way and not just grab the processed thing. And of course these supermarkets are unfamiliar and I would say one thing we did think a lot about upon return and when we debriefed this was giving the students a bit more time to adjust to that situation and to learn their options and to cook because sometimes we were so busy with all these things we were doing every day that they didn’t have much time to plan their suppers, or to go shopping and cook so I’ll let Beth and Marianne chime in because they were on the ground, they know more, but that was the kind of impression I got.

Marianne: So, we had some bargain shoppers in my group that found meal deals at like close Tescos, things like that. And so it was always kind of a competition of “Did you know that the sandwich was included in the meal deal?” And so it was a pretty inexpensive breakfast and lunch and sometimes dinner opportunity for students that became somewhat of a game, to figure out, like, what are you going to put in your meal deal this time? And so a lot of our students were supportive in terms of sharing different deals that restaurants were doing. Did you know that on Tuesday, they have a student special where you can get this, this, and this. And so they were really great about sharing some of the tips and tricks and things that they picked up along the way. And then also sharing meals. So going to the grocery, and he brought me to purchase something, while I may not eat this whole thing, but if you split it with me, then I’ll get the next one. And so they were really great, that was really fun to see them kind of helping and sharing deals that they found along the way.

Beth: And one of the things that we did is we actually offered a time if someone wanted to come with me to the grocery store. We did a local one so they could see how close something was if they by chance needed something quick to eat. But then we actually went with them, which was one was a little bit farther away have more of the discount kind of larger what they would think of a supermarket type of thing here in the United States, just because, over there, you kind of buy more what you need, versus “I’m going to have lots in the refrigerator and freezer within it.” And we actually had a couple of times where we had meals together because it was someone’s birthday and we wanted to celebrate. And very similar to what Marianne said that they would be like, “here’s a deal,” or “hey, I’m going to make soup anybody else want?” And we had one student who loved to cook, and others are like, hey, awesome, I will help clean up, or pitch in for some money if you would be willing to be the person that actually wanted to make the meal, and they actually collaborated teamwork that way too. So it was really cool to see.

Beth: One thing I wanted to share is the fact I think people think that education abroad is three weeks, and then you’re done. For us, this is a lifetime connection for these students. So we actually had dinner with both groups separately, so they could get together and meet each other and see each other, I’ll get messages being like “Guess who I saw on campus?” and they have a competition of how many times they see a certain student, be like “I saw them three times this week, Beth, I saw this one four,” but even moreso is this confidence coming back to have to go after the dreams that they want. We had a student who, I’ll be very honest, had a really rough home life and had a lot of confidence issues and got over there had a chance to start talking, had a really good conversation with a couple employers. And we did a networking night where we invited all the employers back and they could come and network with the students. And she had a really good conversation with some of our staff that we actually had come over from UK to kind of see the program as well. And she followed up, wrote a note back to say thank you for this conversation, I appreciate it. This is what I’m looking for in terms of career or job, and that person connected her with to somebody back here in Lexington, she then goes and reached out to that person, met with them, interviewed, and now has an IT position that she never thought possible a year ago. So that’s really cool to actually see them do this steps, it’s one thing for us to say go do, it’s another for them to actually gain the confidence to go and actually obtain it.

Rebecca: What a great story.

John: One of the things that I think you’ve all mentioned is that this creates a really tight bond among the students as well as the connections to the staff members they traveled with. And that sense of belonging has been shown in a lot of studies to be a major factor in student retention. And I think programs like this can create really strong bonds that can help students be more likely to succeed.

Sue: I will agree with that. There were two young women on one of the programs who became fast friends. And I assumed they had been friends forever, and I just was chatting with them, and I said, “You know, you must have known each other a long time.” They said “no, we just met.” And one of them said that she was so excited to come back to UK in the fall… so this semester… and I said “well, weren’t you excited anyway?” And she said, No, she wasn’t, that her freshman year had been a little lonely, and she had not made a good connection with her roommate and was struggling a little bit to fit in. And she said “Now I have a best friend on campus, and we’re gonna have fun the next few years together. And I thought that was awesome.

Marianne: And I’ll brag on our students. They were phenomenal. I mean, when I told people that I was going to go to a foreign country with 15 college students, and we were going to travel the city and we were going to do all of the things they looked at me like, “Why would you take college students to an international city?” They were fantastic. They were supportive. They were curious. They were beyond what you could even imagine in terms of the questions that they were asking and the way that they engaged with the curriculum. We have phenomenal students here at the University of Kentucky and I was lucky to get to take 15 and I have them running across campus yelling my name saying “Oh my gosh, this is the first time that I’ve seen you since you’ve been back on campus” or seeing each other on campus is such an honor to be a part of just that family that we now have. And, like I said, they were the best students you could ever imagine traveling with. I do it again in a heartbeat.

Sue: So one thing that really impressed me about these students, actually taught me a lot about this category “first-generation” which is kind of thrown around is that these students are really amazing. I mean to get to the University of Kentucky, to be studying their majors, to be making good academic progress is an accomplishment for these students and they have the resilience, they have the resourcefulness, they have the curiosity, as Marianne said, to make the most out of education abroad. So these are not students who took this for granted. When they were in London or Dublin, their eyes and ears were open all the time. And they were busy taking it all in, reflecting on it, and they absolutely were some of the very best students I’ve ever seen on an education abroad program.

Rebecca: So do you have plans to evaluate the success of this program?

Sue: So yes, we built assessment into this program from the beginning. So we had a researcher from the College of Education who helped us and administered pre- and then during, and then post-surveys of each student. So she collected information about their responses and reflections to the assignments and to their learning, and also something about their intercultural learning as it were. So we’re going to also track these students and see how they do compared to the peers who didn’t get the opportunity to study abroad in terms of their academic progress and their graduation.

John: Excellent. We look forward to hearing more about how well this program works. We always end by asking, what’s next?

Sue: Well, we want to do this again. [LAUGHTER] So we think it’s working. We’ve got good results so far, assuming that the next summer is also successful. We hope to just keep tweaking it, making it better and better for the students and maybe building it in as kind of a signature program for first-generation students here at the University of Kentucky.

Rebecca: An incredible thing to invest in and offer first-gen students. Thanks so much for sharing the details of your program.

Sue: Thank you for having us. And thanks for your interest in this endeavor.

John: It sounds like a wonderful program.

Sue: Yeah, it’s been a blast to develop and to be part of I must say. It’s been fantastic. And I don’t think we mentioned but perhaps we should that over one quarter of our undergraduate students identify as first generation. So this is a significant population at our university which serves students of all sorts from the state of Kentucky and outside.

John: Excellent.

Sue: Thank you both.

Marianne: Thank you all

John: Thank you for taking the time to join us and to share this wonderful program.

Sue: Yeah, appreciate it.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]