344. Failing Our Future

The traditional grading system that we are all used to is of relatively recent historical origin. In this episode, Josh Eyler joins us to discuss research on problems associated with traditional grading systems and possible solutions at different scales and in different educational contexts.

Josh is the Director of Faculty Development, the Director of the ThinkForward Quality Enhancement Plan, and a faculty member in the Department of Teacher Education at the University of Mississippi. He is the author of How Humans Learn: The Science and Stories behind Effective Teaching and a forthcoming  book, Failing Our Future: How Grades Harm Students, and What We Can Do About It.

Show Notes

  • Eyler, Joshua R. (2024, forthcoming). Failing Our FutureL: How Grades Harm Students, and What We Can Do about It. John Hopkins University Press (pre-order link)
  • Eyler, J. R. (2018). How humans learn: The science and stories behind effective college teaching. West Virginia University Press.
  • Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., … & Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of educational research, 86(4), 803-848.

Transcript

John: The traditional grading system that we are all used to is of relatively recent historical origin. In this episode, we explore research on problems associated with traditional grading systems and possible solutions at different scales and in different educational contexts.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Josh Eyler. Josh is the Director of Faculty Development, the Director of the ThinkForward Quality Enhancement Plan, and a faculty member in the Department of Teacher Education at the University of Mississippi. He is the author of How Humans Learn: The Science and Stories behind Effective Teaching and a forthcoming book, Failing Our Future: How Grades Harm Students, and What We Can Do About It. Welcome back, Josh.

Josh: Thank you. Thank you. Great to be here.

John: We’re happy to talk to you. And it’s been a while. Today’s teas are:… Josh, are you drinking tea with us today?

Josh: Well, you know how I roll, you guys, I don’t have tea, but I have some lovely water. [LAUGHTER]

Rebecca: So tasty. I have a Scottish afternoon today.

John: And I’m trying to cut back on caffeine, so I just have a peppermint tea today.

Rebecca: Well, if you wanted to cut back on caffeine, you could join Josh with water. [LAUGHTER]

Josh: That’s true. [LAUGHTER] Come join the club, John. [LAUGHTER]

John: I suppose that probably would not be an unhealthy thing to do. [LAUGHTER] And I have been drinking a lot more water recently.

Rebecca: So, we invited you here today to discuss Failing our Future. Could you tell us a little bit about how this book project came about?

Josh: Sure. Yes. So it has a couple of origin stories, actually. One is that when I was writing How Humans Learn a few years ago, I was working on the final chapter on failure. And I kept coming across research on grades and grading and the obstacles that they set up to learning. And certainly if you’re thinking about failure as a tool for learning, you immediately are confronted with the fact that in systems that prioritize grades, they push back on the natural cycle of learning, where we try something, we fail, we get feedback, we try it again. Grades are set up in the opposite direction, they arrest that process before it can really play out. And so that is what piqued my interest. And I don’t know that I could say honestly that I thought I was going to write a book about grades at that point. But I knew that it was an important element of what I was discussing. So I’d say a few years after that, I think what we were seeing was a lot of discussion about grades, a lot more experimentation with it. That led me to want to write a book for a broader audience, one that certainly included educators, but one that cut across the K-12, higher ed divide one that was also for parents and policymakers and students, one that really took a bird’s eye view of the larger conversation about grades, trying to pull all of what we know together so that we could move forward as a community to try and enact change. So that’s what got us here. And the process was certainly longer than I expected due to the pandemic, but it was also just a very illuminating process. And I heard some heartbreaking stories as I did interviews for this. But overall, I’m really proud of the work.

John: And you mentioned addressing this through the entire educational spectrum. And I think it’s important to address it through the whole system. Because by the time we see students in college, they’ve already been indoctrinated into a system of grades, and there’s a lot of resistance to change, and also a lot of damage, perhaps, may have been done by the use of grading systems early. Could you talk a little bit about how we ended up with this system of grading, which has been so much a part of the educational culture from kindergarten on up?

Josh: Sure, yeah. And you’re right about the fact that students are conditioned for at least 12 years before they get to us to think about grades as being the most important thing about education. So how did we end up here, we could have a podcast episode that would last five hours if we really wanted to dig into that. But I’ll focus really on the more recent history. And that is that the A through F letter grade scale that we have is really about 125 years old. Our first records of a full letter grading scale come from Mount Holyoke in the 1890s. So they were the first to implement it. Back then it was A through E. They later dropped the E because they were afraid that people would think that they were excellent when they were not, you know, God forbid that we allow people to think that they’re excellent. And so they dropped the E and added a letter where there could be no mistake about what it meant, and that was an F, for failure. So that’s when it began. But that system, the letter grade system, was not formalized, or standardized, really until the 1940s. That is when you see a majority, in fact, of school districts and colleges and universities adopt that system. And what I think is most important about that, actually two things. One is that none of this has ever been inevitable, that the 1940s is less than 100 years ago, so this is not something that was cast in stone at the minute the American educational system began; it has changed and can be changed. The second thing, though, is that all of these schools, districts, all of these colleges adopted that system, not because they thought it was the best way to document student learning, but simply because it was the easiest way to communicate across institutions. They felt that if they had a common system that they could communicate more effectively between themselves. So it was not about student learning. It was not about student progress or growth or development. It was simply about communicating. That’s how we got here. And now we’re trying to figure out where do we go next? How do we undo some of the damage that has happened since that time?

Rebecca: Speaking of damage, do you want to underscore what some of that damage is? [LAUGHTER]

Josh: Sure, and I know that there’s room for reasonable debate about the terms that we use here. But I honestly really do think we can use the framing of damage and harm when it comes to grades. And in the book, I have several categories. The first and most obvious category for that damage has to do with learning, that grades set up obstacles to learning. They inhibit curiosity, they inhibit creativity, they inhibit risk taking, they affect intrinsic motivation. This is painfully obvious, but grades are classic extrinsic motivators, which means that they are very good for getting people to do things that they would not otherwise want to do. Extrinsic motivators operate effectively, if your goal is compliance, you want to get people in seats, you want to get people to turn things in on time, you want to get people to say things in class, grades work for that. But if what you’re interested in is learning and quality, that’s what you need intrinsic motivation for. The grades can get people into learning spaces, but they in no way ever guarantee that a student will learn even though they are actually in the environment. So that’s really important. Environments that prioritize grades also incentivize cheating, and they just stand in the way of a lot of different things. But that’s just the academic part of it. Obviously, those are important, but to me, they’re less important than some of the effects of grades on students’ lives and wellbeing. Grades magnify and mirror inequities that have always been a part of the American educational system. For example, students who attend poorly resourced high schools have fewer educational opportunities, fewer textbooks, more teacher turnover, all the things that are tied to less-resourced schools. And what that means often when they get to college, they have experienced what we call opportunity gaps, which show up in their grades, especially in Gen Ed courses. So those grades that you see in the first couple of years of a student’s college experience, one who has experienced opportunity gaps, those are reflections of the past, they’re not indications of the student’s potential. They are indicators of systemic inequity. So that’s just one of many examples that we could rifle through. Grades are surveillance technologies. They’re often used for punishment, especially in high school, but kind of across the board. So that’s another category. inequities. And then the final one, the one that we’re getting more and more research on now, maybe than we’ve had in the past, and one that I personally care a lot about is that we have evidence now that grades are a contributing factor to the mental health crisis in teenagers and young adults, the academic stress caused by grades. We have a number of research studies pointing us toward the significant contribution of grades to that mental health crisis. So lots of areas here, I think, beyond the classroom. And that’s really our central idea of this book that grades have long afterlives, well beyond a semester, well beyond the classroom, that affect people’s lives, sometimes just in the short term, but often in the longer term as well.

Rebecca: Josh, you went from going from grades are no fun to grades are a super downer. [LAUGHTER]

Josh: Yeah, well, that’s the message. It’s a happy book, Rebecca. [LAUGHTER] It’s not going to win any awards for a happy smiley story, that’s for sure. [LAUGHTER]

John: One concern that some faculty have about moving to alternative grading systems is that, while intrinsic motivation is something we’d all really love to see in our students, there may be some tasks in our disciplines that students have to master which may not be as intrinsically rewarding as others, but they might still be foundational for students to be successful. If we move away from grading systems, what type of motivation can be provided to help students master those tasks that may seem tedious and may not be quite as intrinsically rewarding as other areas that students just find much more interesting?

Josh: Well, that’s a great question. There are a couple of things I’d like to address about this. So first of all, it’s not that we’re talking about either having traditional grades or having no grades, and nothing in between. What a lot of people are doing in the area of alternative grading practices is experimenting with a whole range of models. And so particularly for the types of courses and disciplines that you’re talking about in that question, John, I have found that many faculty gravitate toward a model called standards-based grading, where you can identify the skills, the content knowledge, the disciplinary norms and necessities that are important for students to develop. And the grade for the course is based, not on individual performance on exams, but how many standards they meet, over the course of the semester. And as a feature of that particular model, often students are given multiple attempts and multiple ways to meet the standards. So that’s part of releasing the pressure valve a little bit for students that gives them room to grow and honors the fact that individuals learn at different paces. So it doesn’t matter when in the semester that they hit the number of standards in order to get their A or B, because the process is a fundamental part of that grading model. So I think that’s really important. Another thing that often comes up in these conversations, though, is the fact that we do in fact, have gradeless colleges in America. The one I feature in the book is Evergreen State College in Washington. And they don’t have any grades at all. They have fully narrative transcripts. They give only feedback over the course of the semester. And they teach all the disciplines. So they have found ways to heighten the intrinsic motivation, and to use feedback to really help students navigate the path toward the goals that they have for themselves and for the class. So there are ways to do this. You don’t need grades to keep people in the seats or to have them do things that might draw on less intrinsic motivation. I think there are ways to structure our learning environments that allow us to do similar work without the pressure of traditional grades. And I think that’s the ultimate point here. I think what a lot of folks in this area who are interested in grading reform are trying to promote is not necessarily just ditching grades outright, although we could talk about that if you want, but reorienting students relationship with grades, the messages that grades send to students, so that it’s not necessarily an evaluation, but a tool helping them develop their skills and to push their learning forward.

Rebecca: It’s always been interesting to me that the A through F system was meant to provide some standardized ways of communicating between institutions yet, if you look at any single institutions’ body of syllabi, you can see that the grades mean entirely different things [LAUGHTER] depending on a class, like some might be about attendance, some might be about success on a test, some might be about achieving learning objectives. So it seems like if it was meant to communicate anything [LAUGHTER] across institutions, it certainly isn’t meeting that objective. I don’t know what my question is. [LAUGHTER]

Josh: I’m so glad this up, though.

Rebecca: I had a question, but I think I lost it. [LAUGHTER]

Josh: No, I’ll answer it. There’s a question in there, Rebecca.

Rebecca: Thanks for helping.

Josh: What you’re talking about there is what I call the measurement fallacy. And so there has been more and more work over the last few years, including one that I absolutely love, called A Century of Grading Research, where a team of experts dives into a massive amount of material. And the conclusion that they come up with is that a grade is nothing more than a subjective indicator by an individual instructor on a student’s progress toward that individual’s goals for a particular course. So I set the goals for my course, a grade that I would give is nothing more than an indicator of how much progress a student has made on my goals for my course. They call them learning intentions in this paper. It is not in any way, a kind of universal certification of learning in a particular course or discipline. Nor does it mean that the student who gets a certain grade in my course would get the same grade from my colleague down the hall teaching the same course. It is a truly subjective indicator of progress. And because of that, we cannot really say that grades measure what we have been told that they measure and what our educational systems have assumed that they measure, which is learning. They’re not universal measurements of learning, they’re subjective indicators of progress in the course.

Rebecca: And yet they’re used to make all kinds of decisions about students.

Josh: They are, and you’re absolutely right.

Rebecca: It’s very interesting. [LAUGHTER]

Josh: So I think there has been a lot of ill placed weight on grades without a subsequent amount of investigation into what grades have meant, and continue to mean. This is also what fuels the furor over supposed grade inflation. And there are lots of other tendrils of problems, when you begin to put so much emphasis on grades to do so much work in our educational system.

John: You mentioned Evergreen State College, but another college that had gone in that direction, very successfully was New College, and I teach in a program at Duke in the summer, and I had two TAs from New College, and they were two of the brightest people I had ever worked with, and their mastery of the subject matter was very much equivalent to that of other students I had who came from institutions with very traditional grading systems. So they certainly didn’t seem to be damaged by that. And yet, there seemed to have been a bit of a hostile takeover of New College. [LAUGHTER]

Josh: Yes, there has been but there is not evidence yet that the hostile takeover has affected that gradeless model. There was some discussion that I read in transcripts of board meetings about that grading system, but it has not changed yet. And I’m glad you brought up New College, John, because, and they have this on their website, as recently as last year, they were able to boast that they were producing students who went on to get the highest percentage of STEM PhDs in the country, relative to their size as an institution, which says a lot. If you are a gradeless institution, and your students are succeeding at that rate in STEM PhDs, it means that they’re learning not just content, but also the skills that are necessary to do that level of advanced work. So I think that that says a lot for what is possible, even within systems that do not have anything close to a traditional grading system.

John: And I should note that one of those students did go on to a PhD in economics. And the other student went on and picked up a master’s degree in data analytics. And they’ve succeeded very nicely, despite the absence of grades [LAUGHTER] in their college career. [LAUGHTER]

Josh: Imagine that.

John: When we began this discussion, one of the things you noted was that under traditional grading systems, the grades at the end of courses often reflect differences in the opportunities that students face before they enter our classes. Can you talk a little bit more about that?

Josh: Absolutely. So you have the reinforcing of those gaps, you have extensions of those gaps. So if you think about what happens to a student who comes into a college course with those opportunity gaps, and then is in a system, for example, where grades are curved, so not only then are they trying to bridge over those equity gaps, but their grades are really reflective of those gaps. But now they are also competing in a curved grade system with their other fellow students, many of whom have had more practice at the kinds of exams and the kinds of questions and the kinds of teaching strategies that they’ll see in those courses. So it just starts to pile on top of each other. And I think that this is something that we just don’t talk enough about, it’s just assumed, and many of these students are labeled unprepared or not ready for college, which places all the burden on them rather than this more systemic problem that I think we really need to face. Because we don’t talk enough about it, we assume that grades have to be a part of the landscape of education. And because of that, we, and I say we as the community in education, we’ve just been willing to tolerate all of the issues that grades have brought with them without really pulling back the curtain and looking at what the issues really are.

John: And we lose so many students in the first couple of years of college and many of the students we lose are those who come from low-income school districts, whose parents had less education, and who just come in with less preparation. And that’s not a very equitable way of providing an education.

Josh: Right, absolutely. And so this shows up on all kinds of metrics that colleges care about: retention, progress, graduation, all of which, by the way, are tied to grades and GPAs. That grades are the gatekeepers for keeping those students enrolled and moving through to graduation. So yes, that’s a major problem to address with respect to those students who are coming to us with fewer opportunities and from school districts with fewer resources. I think we need to really investigate the traditional ways of being In higher education, really look closely at them, reimagine them in order to create systems that have equity at the center and where we are actually, I think, invested in student success and helping those students from those different backgrounds to succeed.

Rebecca: I think the other thing to underscore related to equity issues is not only does an institution maybe have policies about grades and decisions are made at an institutional level, but at the federal level grades are used for financial aid. And so if you don’t hit a certain grade point average, and if you don’t have a certain number of classes that you complete successfully, so you’re not withdrawing from them, or having incompletes, etc, then you might not be eligible, you could lose financial aid. So whether or not a student has demonstrated growth in any kind of way doesn’t matter. It’s down to this idea of grades. And depending on the classes they’re enrolled in and the different things that grades mean, we’re essentially not allowing students to proceed because they can’t afford to.

Josh: That’s absolutely right. The more you really take the magnifying glass to this, the more you see how implanted grades are in all of these decisions, and all these key points in a student’s academic career, bringing in financial aid, I think, is a wonderful example of their gatekeeping function. And the idea that you’re raising there, that it doesn’t even give students a chance to try and bridge those equity gaps. It doesn’t honor their growth or development at all, it says you got less than a C average in your first year, therefore, we are not giving you any more money to move through the university, and so many leave, many dropout. And I think that there is a better way to do things.

John: And many of those students who leave end up with a fairly significant burden of student debt that they still have to pay, further increasing the inequity. What types of alternative grading systems do you discuss in your book, you mentioned standards based grading, but what are some of the other areas that you encourage faculty to consider?

Josh: Well, the book is divided into two parts. And the first half is all the problems and the second half is possible solutions. And so there’s a chapter for parents on what you can do in the home to help your children reorient their own approach to grades. And then the last chapter is about systemic change. But the one in between that is focused on what teachers in K-12 and faculty in higher ed are doing in their own individual classrooms to help with this. And so, there’s a whole range. There are the models that are related to standards-based grading, I call them the cousins: they’re standards-based grading, specifications grading, competency-based, mastery-based, proficiency-based, they’re all not very different from each other, they just have slightly different names, and maybe a few modestly different features to them. So that’s one bucket. Portfolio grading is one that I recommend for folks who just want to dip their toe in the world of alternative grading, because a portfolio model, you’re giving a lot of feedback throughout the semester, a lot of opportunity to revise and redo assignments. But ultimately, the portfolio that is turned in at the end of the semester gets a fairly traditional grade associated with it, it’s just that that grade honors the whole arc of the work for the semester. So that’s another one. Contract grading, and its various branches that we have recently seen. So classic contract model was developed in the middle of the 20th century. And it looks something like this: here’s a list of things to do for the course, if you do 15 of them at a satisfactory level… I’m just making up that number…if you do 15 at a satisfactory level, you get an A for the course, you do 12 you get a B, etc. That’s a contract model. More recently, there’s been a version of it called labor-based contract grading,…very prominent in writing studies… that tweaks it a little bit to emphasize more the amount of work, the amount of writing that students do over the course of the semester, and that is tied to fulfilling the particular contract. And then if we’re looking at a spectrum of grading models, with portfolio grading being one of the more conservative of the alternatives, on the other end of the spectrum you have what some people call ungrading and other people call collaborative grading where there are no grades throughout the semester, only feedback, lots of student self assessment, self evaluation, and then at the end of the semester, the students proposed their grade and the final grade is determined through a conference between the instructor and the student about that proposed grade. So there are lots of things that people are trying. I tried to send two messages about this, one is that my goal is hopefully to help faculty find models that will work best for them and their students, that it’s not a one-size-fits-all model. The same thing that works for me may not work for my colleague in the next classroom over. So that’s important. The other thing is that you do not need absolute fidelity to any one of these models. It’s not like Moses came down from the mountain, with tablets that you had to follow to the letter, lots of people are mixing and matching and taking elements from a host of different systems that they find works for them. So I’ve yet to find someone marching down the checklist for engraving or for contract grading, everyone’s kind of putting their own spin on it, and that’s good. Well, it’s actually not only good, it’s important since our contexts vary so significantly across higher ed.

Rebecca: As a lot of faculty start considering these different alternative models, collectively we can start to initiate culture change, kind of with a grassroots model. But systemic change requires policy change and other things as well. Can you talk a little bit about what role we might have in pushing forward some of those agendas as well?

Josh: Like I mentioned before, a major reason for writing this book was because my observation was that a lot of people are talking about grading reform, but they’re all coming at it, understandably, from their own perspective, the faculty perspective, the administrative perspective, the policymaker perspective, and the parent’s perspective. And I think that if we’re thinking seriously about systemic change, we need to have everyone on the same page collaborating to move change forward. All that is to say that I think about this question quite a lot. There’s certainly examples that we have of recent systemic change, some of the University of California schools have changed their grading systems in significant ways. Western Oregon just dropped the lowest grades on the scale, they’re no longer available to give. I just met someone a couple of weeks ago from Bryant University, they’re moving to collaborative grading at scale for their first-year seminar courses. So it is happening, what it requires is a network of people across an institution, all of whom believe that this is not only the right thing, but they understand how to use policy to make the reform happen, but also how to tell the story in a way that all the different constituencies can see themselves in it, and can agree that this is the direction that they need to head. So the networking is important, understanding how policy shapes grading habits and processes at a university. If you’re part of a public system, which I know you and I both are, you need to understand how the system policy and the state policy plays into this as well. So that requires having that network of different people at different positions in a university to really move that work forward. But what I really want folks to know is that you’re not alone in this, that there are lots of people thinking about this, and lots of people who are doing this work, sometimes under the radar, sometimes above the radar at institutions, and that one person taking a step is a step toward change. But multiple people taking the same step together begins to create a movement toward change. And so I want people to know that. I also want people to know that there are blueprints out there for how to do this work, that there are people who study grading reform, there are models out there for successful institutional reform. Given my work for the book, I think we have a lot to learn from K-12 school districts. There are so many of those each year that are transitioning to standards-based grading across the district. Last year, for example, the entire city of Santa Fe, New Mexico, all their school districts moved to standards-based grading. So this is happening. And the more we learn about process, the more we draw on our colleagues’ network and expertise in these areas, the more we work kind of as a collective in higher ed to push this forward, the more change you’re going to see.

John: We give a lot of workshops on campus and some of them are focused on alternative grading systems. We haven’t seen quite as much movement with that among faculty as I thought we perhaps might, because during the pandemic, a lot of people were open to trying some very different things. But there’s been some resistance. We’ve had a number of people trying it, but it hasn’t caught on quite as much as I had expected it to. Why are so many faculty resistant to moving away from traditional grading systems?

Josh: Well,I think this varies from place to place. But I will say that I think that a major thing that we all face as faculty is the pressures of time. Everyone wants to do their best for their students, I really do believe that, but when you’re faced with such a limited amount of time in which you can change elements of your course, you’re probably going to gravitate immediately toward the kinds of content that you’re teaching in the course in the assignments, the course design pieces of it, or you’re going to think about active learning strategy that John and Rebecca talked about a few months ago, rather than addressing the thing that is at the very foundation of our educational systems in America. That’s not going to be the place that you go first, [LAUGHTER] kind of an upheaval of everything that you have known about education. So I think some of it is just, in a system where we all have very limited time, and very few resources, where do you put your efforts, and I think that is driving some of that. I also think we’re kind of seeing this interesting bounce back that followed that period of innovation at the beginning of the pandemic. I think what you see is almost a defensive response to that period of innovation, that what we really need to do to bring students back and re-engage them in the coursework is to try and somehow recapture what our image was a traditional education pre-2020, that we need to move backward toward that rather than capitalize and extend the innovations that we were doing in the early stages of the pandemic. I don’t want to paint with too broad a brush on that, but I have seen some of that elasticity, that rubberband effect, in talking with folks across the country about some of these issues. So I think those two things are at the forefront of why some folks might resist that. And none of those really has to do yet with really trying to unpack people’s own philosophies of education, or how their grades and their grading models tie into their values that they have with respect to education. So that’s even kind of a deeper level that you can’t even get to until you address some of these other concerns.

Rebecca: And when we’re crunched on time, things that we’ve done before are easier to implement. And it’s also hard to find time to reflect on our practices and to do some of the things that you’re talking about, in thinking about how our values align with what we’re doing. We’re really good as institutions of talking about equity, but we don’t always fully analyze how our practices impact actual equity.

John: And we were all the products of a graded system. And we were somehow successful in that, or we wouldn’t be in these positions. And so I think there may be a little bit of psychological resistance to changing something that has been so fundamental to our own experience.

Josh: Yes. I think a huge capital Y-E-S [LAUGHTER] to both of what you’re saying, that Rebecca, your point, we are not very good at really interrogating how our practices may or may not be aiding our equity goals or advancing our equity goals. And John, yes, we have succeeded in graded systems. And I do think the psychological is a part of it. If we were able to do it, why shouldn’t other people be able to manage this? I think that is what some people think. And more than that, I often see a kind of defensive fallback. Part of this is natural, in that we love our disciplines and devoted our lives to our disciplines, but a fallback toward if I get rid of grades or if I change my grading system, what does that mean for the standards of my discipline, for how people will engage with my discipline? And so I think that’s a psychological element of this as well. And it comes out in arguments about rigor and standards, but what it’s really about is the individual psychology, I think, of the person making the argument.

John: Are there other topics from your book that you’d like to discuss that we haven’t?

Josh: I think the reform efforts that I have seen succeed, and those that have failed, always have hinged on communication, at every level. Why are we doing this? What is the purpose of it? How do we bring people into the process very early on at all levels. At the K-12. level, that means parents, teachers and administrators working together. I think at higher ed, it means utilizing the expertise of faculty right out of the gate, allowing them to shape the narrative and the conversation and the direction and draw on administrative and staff resources to help enact that vision, rather than having a top-down mandate that you had to change your grading. That’s never gonna work in higher ed. But I will say that the communication is what drives all of that work. And it is the hinge that either allows one of these efforts to succeed or fail.

Rebecca: Well, we have a lot to think about, but what’s next, Josh?

Josh: So, what’s next? Well, the book comes out at the end of August and so I’m really excited to launch that and to finally have it in people’s hands and have lots of conversations about what’s in there, hopefully, So, that’s what’s immediately next. I am thinking about the next project that has something to do with the students who are coming to college now are the students who their entire K-12 experience has been shaped by the Common Core, and the obsession with standardization in America, and so what does that mean for higher ed? And what does that mean for those students and their learning? So, I’m in the very early stages of trying to think about that a little bit, but that might be what the next project is.

Rebecca: You always have great projects, Josh, and get us thinking about really important topics. So thanks for your work. I’m looking forward to sharing your new book.

Josh: Well, thank you both very much. It’s always a pleasure to be on this podcast, one of my favorites, and I’d love talking to you both about all these issues, so hanks very much.

John: It’s great talking to you again, and I’m looking forward to receiving my copy of this book in the summer. I ordered it as soon as I saw the notification that pre-orders were available.

Josh: I appreciate that, John, thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

341. Learning Losses

The transition to remote instruction during the COVID19 pandemic resulted in dramatic learning losses. In this episode, Peace Bransberger joins us to discuss a report that analyzes the extent and persistence of these learning losses. She is the Interim Director, Programs and Evidence, Policy Analysis and Research, and Programs and Services at WICHE, the Western Interstate Commission for Higher Education.

Show Notes

Transcript

John: The transition to remote instruction during the COVID19 pandemic resulted in dramatic learning losses. In this episode, we discuss a report that analyzes the extent and persistence of these learning losses.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Peace Bransberger. She is the Interim Director, Programs and Evidence, Policy Analysis and Research, and Programs and Services at WICHE, the Western Interstate Commission for Higher Education. Welcome, Peace.

Peace: Thank you.

Rebecca: Today’s teas are:… Peace, are you drinking tea today?

Peace: I have drank tea and I ended my tea drinking portion of my day with a Trader Joe’s maple espresso tea.

Rebecca: That sounds interesting.

John: I’ve had some of their teas, but I’ve never had that one.

Rebecca: It sounds energizing.

Peace: Yeah, it’s a black tea, has a bit of a smokish coffee kind of impact from the espresso.

Rebecca: Interesting. That’s a new one. I don’t think we’ve had that one yet.

John: No, we haven’t. [LAUGHTER] Well, I have an old one here, a spring cherry green tea in the hopes that we will see spring here. We had a lot of snow in the past week. We’re recording this, we should note, in late March.

Rebecca: I have a Lady Grey today.

John: The Western Interstate Commission for Higher Education is focused primarily on post-secondary education, yet you issued a report which is titled “Navigating Learning Loss and Changing Demographics in Education” in February of this year. Could you tell us a little bit about why you had this focus on learning losses in elementary and secondary education?

Peace: Well, so my organization goes by the acronym, WICHE, you had it correct. We’re a Higher Education Commission. And one of the things we’re known for on the research side of things, because we do a whole bunch of other things to support the 15 Western states and then outlying Pacific territories, higher education systems, and one of the types of research that we’re known for our projections of the number of high school graduates. It goes under the long-standing title of “Knocking at the College Door,” and the projection of the number of high school graduates so that state and institutional planners can strategize around overall student flow trends. We last issued the update to that 40 year ongoing research in 2020, when COVID was first raging, and we issue these projections roughly every four to five years. So we’re in a prep year right now. As part of my job, and being the lead on the network, I am always monitoring K-12 trends data. So we’ll have a heads up about whether something would be monumentally different in the space of high school graduation. And as a result of what I was seeing, we decided in February to issue the report, kind of a summary brief, because the data were compounding and resoundingly indicating that yes, something is currently different, and might continue to be different about high schoolers, and younger K-12 populations as a result of COVID. We’ll go into detail on the learning loss side of things, but from the perspective that we really typically focus on,the numbers of high school graduates, the major demographic trends, the reason that we felt we needed get out in front of what we were seeing is because the learning loss, we see from that the potential that enough children and teens may have been so impacted by the learning disruptions and things that a quantitative impact on the actual high school graduation trend is possible. And that’s important to know, because it’s a second layer on something that I think we all kind of have on our minds, some people will call it demographic cliff, we don’t use that term, even though our data are used to depict the slope, the trend line, it’s the coming downturn in the number of high school graduates, because back in 2008, fewer babies started being born. And to this day, there has not been an uptick in the rate of fertility in the United States and across virtually all of the states. We know this, in fact, it could be next year’s high school graduating class that might begin to evidence some of that trend. And so people are front and center thinking about that demographic change, I would suggest, [LAUGHTER] at a minimum is a contraction in the youth population. I don’t know if what that means necessarily for higher education contraction, but we can talk about is learning loss going to do anything to help that? Are we gonna somehow see actually more high school graduates than we might have otherwise expected given C OVID? Or is it more like what I think we’ve probably all been waiting and worrying about, could it impact that trend and deepen it, amplify the downturn in high school graduates?

Rebecca: So you talked a little bit about the data suggesting losses in persistence of learning? Can you talk a little bit about what those losses look like?

Peace: Sure. And, just for our purposes here, I’ll speak to the national kind of overall results and trends. But I would strongly encourage your listeners, even just as a starting point, to go to the web page that I’m sure we’ll put in the show notes where the report resides. And within that page, I’ve been adding to the list where people can access more detailed data than the national trends. I’d go there because then you can poke around, based on your own institution, and get a sense of the kind of school districts that you might know, school districts that are kind of geographic areas that are really strongly important to your student populations. Because the detail is really important. It’s a really multifaceted, nuanced topic. So about the persistence of the learning losses, and this is in the K-12 pipeline. I mean, technically, we work in grades one through 12 data because kindergarten is not a universal requirement, so it can be hard to know what’s going on there, since the trend data could vary year to year. When I mentioned prior to COVID, or pre-COVID, in the K-12 school system, that would typically mean either the 2019-20 school year, or some folks go back as far as 2018-19, because the 2019 school year included the spring that was disrupted, but by then most learning and assessments had already occurred, and then the quote unquote, post-pandemic assessments that we have availability to summarize go through the spring of 2023. So that’s almost a year ago at this point. But by spring of 2023 students started, after a couple of years that we’ll discuss here about what really happened there, students started showing some resumption in the rate of annual learning and acquisition that was typical pre-COVID. So that’s just like, on average, in a given year, the assessments generally will say how close to on-grade-level and then was the amount of typical acquisition achieved. By spring of 2023, the good news was that annual rates, there was some evidence that students were a little bit more closer to back on track. The unfortunate problem, and otherwise not good news, is that students were definitely not on pace during the two previous years. So they lost total learning, and it sort of accumulated. Students would have needed to learn at really unprecedented rates in 2022- 2023, that year, where they are resuming sort of a typical rate, just to make up for two years of lost learning, if that’s even such a thing in learning, which is an accumulative kind of process. There are spring of 2023 results, there are some more recent results from several of the major assessment products for the fall of 2023, so getting into the current school year, beginning of the current school year, and they generally confirm what spring 2023 results showed, that students came into the year with the overall lost learning. At this point, it means that these K-12 students… and we’ll give some statistics by different grade levels and what have you, the nuance, but pretty much from the assessment results, you see the same trend virtually at every grade level, which is that students have been moving along, learning in the given grade that they’re at, but they’re still being bogged down by overall unremedied learning losses. And that’s for four years now, so that’s pretty substantial. One sort of point of reference for those students who were high school freshmen, as COVID was raging, their time is up. So four years, did they get back on pace? Were they able to stay on pace, such as I’ve just described? They’re gonna graduate now, and many of them will graduate, but not having been able to fully recoup what was lost. And so there’s not a lot of data that actually sort of compare, “Okay, so I’ve received my diploma, it was awarded to me. What amount am I behind?” And I think that’s part of the problem. In fact, there is increasing attention to the notion that grade inflation, that has always been something of investigation, but evidence that it may have really been at play during these past four years in a way that is really masking and complicating this issue, not making it clear whether students who are graduating from high school, would they be considered on par with previous cohorts that were emerging even prior to COVID?

John: So basically what’s happening is students seem to be learning at the same pace they were pre-COVID, but they’ve all been left behind fairly substantially as a result of that transition to remote learning. And they haven’t caught up to where they would have been had we not gone to that experience.

Peace: Yeah.

John: Were those losses roughly the same everywhere, or were they particularly bad in lower income communities?

Peace: Well, let me give you first even just a sense of the scale of losses, and some of this, you almost have to see it to comprehend it, but I think I can kind of show the scale. So this is high school, stick with high school students, and so they’re the ones most immediate to our faculty might see. It was reported in October, the high school students’ scores on the ACT College Admissions Test had dropped to their lowest point in more than three decades. And that was describing therefore the class of 2023, some of which are presumably in college right now. And they were in their first year of high school when COVID hit. The average ACT composite score for U.S. students was 19.5 out of 36, for that class of 2023, which was down from the prior year 19.8, which we’re talking already that those were some score levels that might not have been ideal to begin with. For as regards to SAT, total score declined for the class of 2023 as well down to 1028 compared to 1050, for the class of 2022 and compared to 1060 for the class of 2021. So really, those are just a couple of data points about this notion that schools are graduating students but what that means when they’ve graduated could appear very different by the time they arrive to college. Now, it’s hard. Sometimes people might poke holes on those type of data because ACT and SAT are not taken by every single student. So the other thing I’ll point out is that we’re focusing on COVID impacts here. But it’s important to point out that in those two assessment instruments, ACT and SAT, scores had been falling prior to the pandemic. And so the pandemic just accelerated those declines, accelerated and amplified them. Since we work in the demographic space, on demographics research, I’ve been talking to other researchers about possible reasons for that pre-COVID decline trend, and just, frankly, how hard it is to reconcile with graduation rates that had continued to increase over the same years, and then the grade inflation, so we don’t have conclusive answers on that. But it’s worth noting, we’re talking COVID. The question might be for faculty and instructors is, do things feel particularly difficult with incoming freshmen at this point, in some way, shape, or form, and probably in very nuanced ways, depending on discipline. But then it’s also like, are they feeling pretty good, prior to COVID, were they where you want them to be anyway? So assessment results from elementary and middle school grades, the one that provides some of the most normed results, and therefore can be compared over time and as a universal sort of indicator, is the National Assessment of Educational Progress, or NAEP for short. They’re the thing that really caught my attention. We tried to highlight where the score drops for 13 year olds, they’re no more or less important than any other grade level, or school age. But those are the next in line coming through high school. So we’ve just seen what was going on with the high school age students during that period. Well, the NAEP 50th percentile mathematics score in 2022, was 282. In 2023, it was 274. That was at the 50th percentile, so an eight point decrease at the middle, the decrease on the already relatively higher scores at a 90th percentile was six point decrease. So even the highest percentile, 90th percentile, had a pretty dramatic decrease between those years. And at the 25th percentile, it was a 12-point score drop between 20 and 2023. NAEP reading score declines ranged between three point drops at the 90th percentile to six point drops at the 25th percentile between those years 2020 to 2023. And so there, it gets to the topic that I’ll provide a few more thoughts on about the variability. Were all students affected by this? Which ones more or less so? Right there, that was a statement of a twice as large score drop for those at the 25th percentile, compared to those at the 90th percentile. And this is already on the 90th percentile, they already being, perhaps at or above a proficiency level compared to a 25th percentile, which might not actually be at a proficiency level. And on top of that, you have a steep drop. It’s also worth noting, just like with the SATs, and the ACT scores, that the NAEP scores in that 2023 school year, were just an amplified continuation, some declines that were already emerging pre-COVID, such that in the composite reading score it had by 2023, it was the total average, so at the 50th percentile, seven points lower in 2023 than a decade prior. So over the course of a decade, it was already reducing, and then 14 points in mathematics. So some of these things that we’re talking about is, I don’t know if you want to say learning loss or just what the best word to say it is, because it’s nuanced, but they were approaching prior to the COVID period. And so I really want to highlight that because kind of just in am analogy, prior to the pandemic, schools and students are already losing historical ground. So they were already maybe not in the best shape, so to speak. And now they have to also recover from COVID. And so that can definitely explain some of the lack of recovery and a slow recovery.

John: Going back to the issue of SATs and ACT scores, you mentioned some complications. I’m guessing the major complication is that fewer people are taking the SATs and ACT since at many colleges scores became optional, and the people who are most likely to avoid taking it are those who might on average, expect to do less well on the SATs or ACTs, so that may suggest that the losses would be even greater if we had the same proportion of students taking the SATs and ACT tests as pre-COVID when a larger proportion of schools required them for admissions.

Peace: Yes, that is true. However, the 2023 SAT scores, the participation was the highest ever. So maybe the 2022 that could have been a somewhat more appropriate consideration. It remains the case. We don’t know the underlying distribution of the students necessarily, and if they change year over year in consequential sorts of ways. But I think you’re right. I’m really looking for some good news on this topic. So I can be something other than a Debbie Downer. But the truth is, I don’t think we can look at this and pick away at the data. We went out because it was like if you download the PDF, and you’re not convinced just like access the 30 different year points or different reference tests, and what have you, and see if you’re convinced that this has happened, it really has. It’s pretty affirmative at this point, we’d love to see it turn around, but I don’t think we can just ignore it.

Rebecca: I think it’s really helpful too to point out that it’s not just COVID, the fact that you’ve underscored that, and it might be exacerbated by COVID is really important, because there’s a lot of blaming of COVID on many experiences that we have in the classroom, that may or may not actually be the cause.

Peace: I’d argue they are the cause of what’s seen with the past four years, but we can’t just pretend that that because it was so consequential over those time periods that even a return to normal would be where we want to be.

Rebecca: Oh, of course.

Peace: I think that’s the emphasis, normal wasn’t a good normal. And maybe we didn’t all look at it. It wasn’t so stark, somehow, different people might have been emphasizing it from an equity perspective. I would emphasize it from an economic perspective, because what I won’t highlight here is that there are researchers like Brookings, some of the think tanks, and then in other cases, some more consulting sorts of research organizations that are kind of putting out there, this has implications for the economy. I mean, we can talk about the implications for higher ed, and that part of the economy, but I mean, I just don’t think we can ignore past this, there might have been something brewing, that this was just a perverse sort of way to get our attention on some of it about what the youth of today need? Where do they stand? Are they getting prepared well enough in a way that we need to support the workforce of tomorrow. That’s not the only reason for higher education, but as you and I decide to go take our retirement, these are the kids who will be supporting the country’s economy, and there will be fewer of them. So their ability to do that is really important. So I think, if nothing else, it could be a wake up call. We should really wake up, but we don’t have to wake up screaming and yelling in the house like the fire alarm going off, we need to figure out what to do.

Rebecca: One of the other issues that your report underscored was some high rates of absenteeism. And that’s certainly something I’ve heard my colleagues talk about as well. Can you talk a little bit about some of the potential causes for that?

Peace: Yeah, I will. I also do then want to make a note about something else, but I’ll respond to the absenteeism. So the statistic, 30% of students nationwide were chronically absent in the 2021-2022 school year. So that’s two years into the quote unquote, pandemic period, which is double the pre-COVID19 average. And while not comprehensive, the preponderance of data, were suggesting only minor improvement in the most recent completed school year, 2022 to 2023. That’s huge. Now, chronic absenteeism is different than like average daily attendance and what have you. But still it was a doubling. Absenteeism is the question. I mean, the question is, is it a symptom or is it a cause? And it’s a little bit of both. Prior to COVID students with more day-to-day life or learning challenges were on average, more likely to be absent from school, and a real reason to be absent from school, especially given the kind of hysteria that was almost necessary. As a parent, I got this during COVID. I’m like I was sending my kid to school if they met the temperature well enough for them to go. But being sick is a valid reason for absence. And that was made so much more evident with COVID. And some households and students are just simply more likely to be sick or not recovered as solidly. Now, of course, some of them might already be vulnerable students by virtue of a health condition, but you’ve got students and families that due to their living conditions, or health care access, might be more likely to be absent. One of the phenomenon, if you will, or factors, is social prejudices, and hostile environments for some students more than others. So the Asian and Pacific Islander communities experienced more of that during COVID and that may be lingering in their attendance decisions and the Black Lives movement put in the spotlight the types of stresses that black students might face at school. It can be rational to avoid school, and at this point, some fatigue with that might have set in. So, but even let’s talk about the marginalized students, and is the average student’s disposition to attend school affected by this point in some way, because if it is, then it’s amplified for marginalized students. So school and education that we as adults just talk about and encourage our children to, try to guide them through, pull them through, whatever. They might have become synonymous with very easily influenced young children and their emotional memory with online learning and masking and fear of sneezes and coughs, let alone than what it felt like go back after being socially isolated. And my kid experienced, even in the higher achieving classes, just an unusual rate of disruptions from students transitioning back socially and stuff like that. So these are children. And that can be a far more formative experience. I’m not a psychologist, I can’t say trauma, what have you. But that can be something that that’s all you know, for some of them or a big part of your recent memory. And that can be all you can think of as school, so to ask me to go tomorrow, I might be relying on that recent memory. So I can understand any student in K-12 to some extent, also. Hopefully, as you mature into an adult, you’re able to sort of equip yourself to move past those things. But some of these young adults really having a lot of emotional memory that makes this a real sticky issue, the absenteeism or the lack of kind of bringing their best to the educational setting. I mean, if you want more factors, if that’s not enough, school transportation issues for the past two years and kids literally not having a way to get to school. You’ve got teacher fatigue, and we know how important instructors are in the classroom and what you can bring to it, your ability to do that. And if it couldn’t get worse, because I lived through this with my kid, you still got an unrelenting possibility of like school violence and mass shootings. So there’s a lot of reasons that school does not feel like running through the corridor anything, you know, that maybe we all might have felt as a more positive thing. Now, things hopefully, the last, maybe a year or so where kids are able to start washing some of that out of their memory, and it being replaced with a more normal environment. And hopefully, that’s a good thing for them.

John: One of the things that shows up in the data is while there were learning losses across the board, I believe the learning losses were a bit worse in the area of math. And those seem to be having a pretty significant effect, or at least from what I’ve seen in the classroom, that’s been having quite a bit of an effect on our incoming student body and may have a significant effect on their choice of majors. And we know the rate of return to education in the STEM fields is dramatically higher than it is in other areas. And in terms of the state of the economy, that’s something that could have a very negative impact unless we provide some ways of helping students get caught up in some way. What can colleges and universities do to try to bridge that gap, to take students who, on average are coming in at lower levels, and get them up to the level that they need to be at to be successful?

Peace: As you and I must have been reading some of the most recent coverage on this topic, even just this week. So I can dive into your second question through the lens of STEM. So yes, I had seen some stuff about it more from a HBCU perspective, Jill Barshay of The Hechinger Report, she often does deep data dives. And so earlier this week, she released some interpretations highlighting how the NAEP, those national scores for the K-12 population, those and similar results could conceivably suggest a narrowing of the STEM pipeline for what you’ve mentioned. And so it feels like there are a couple of really interesting points on that… math, at the very least, although clearly, reading comprehension is also very important for sciences and anything, obviously, but those more technical reading types of disciplines. Reading, it cannot be forgotten. So what’s maybe most worth thinking about from what she highlighted was the top students, the NAEP results, you’ve got it 75th percentile 90th percentile, what have you. Top students are staying on grade level, according to those data. And those top students, of course, are maybe definitely the front of the line on the STEM pipeline. But the eighth grade NAEP shows that far fewer of even those who are in the top portion are hitting an advanced performance level or even proficient. So just because you’re in the top, it’s a grading curve, so to speak. Top might not mean what we need for STEM types of disciplines. So, there were learning losses across the board, math scores among the top performers dropped as steeply as did the scores among lower percentile scores. Okay, they call out even the scores of students at Catholic schools. So we understand that that might be a place where some of the STEM students could be concentrated. Otherwise, the scores from those schools would indicate that they weathered the pandemic pretty well. But scores in eighth grade math plummeted. And I just think that that’s another one of these big wake up calls, and it’s in the microenvironment of STEM, but the importance of it to the economy, obviously to the colleges and universities for which that’s a key focus. Now, what might you do even just on this topic, because then I think we can get into a little broader discussion about what to do. I would just ask STEM faculty, if this is the case, if these are the facts, it’s the real fact of the matter. Let’s just free think a little bit and see, to what extent could you meet students at a lower proficiency level if needed. So if it can be quantified, they’re 10% off what you think should be the criteria for even beginning the STEM disciplines, then what have you? If that’s what you have, if that’s going to be sort of the circumstance of even your top applicants, can you do something differently to allow them to actually be admitted? …get on track? What can you do? What would you need to do to actually maybe bridge that distance? If it’s larger, I mean, then obviously, you have to go a little bit, quote, unquote, deeper into the pool or the topic. But if you haven’t, for a while, really look at some of those criteria, sort of indicators and stuff. Because otherwise, we go through the admission cycle, and you might for an entire year of students miss some who could really, with the right approach, potentially continue on their aspiration to STEM. I’d also say, and I don’t really know how this plays out for faculty, and maybe it’s a pie in the sky kind of idea. But we’ve kind of been hearing it from some of our state folks who run the boards of regents and these other sorts of things, which is recognizing that this has occurred, recognizing that it’s always been questionable or difficult necessarily to know, if you could get a guaranteed STEM pipeline, to what extent colleges start reaching backward a little further into the actual high schools and be part of their exposure to and understanding that I might be like, let’s say the eighth or ninth grader, I actually have really, really loved the idea of becoming a scientist or going into medicine or something like that. But I’m starting to waver with my math skills or something. And so these kids aren’t really quite aware. And they’re probably already thinking college and that kind of thing, even at that young age. And if they get a sense that they wouldn’t be admitted, or I’m going to be a failure that early, then they just lose the aspiration, among other things that kind of erode aspiration sometimes in the STEM disciplines. We’ve been hearing from some of the stakeholders, maybe just a real need to actually start acknowledging out loud, whether we can meet students where they are, could we meet them where they are, because they’re the ones who lived this, they know how hard it was. And so their sensitivity to maybe that kind of like, work really hard, and then not actually be able to get into the program they desire and stuff like that. So much of it’s the right thing. But it really comes down to the emotional reaction and decision, as much as quantitatively, could they be close enough to be accommodated, which would be in our better interest if that’s even a possibility? We have to be looking at, I can’t say up front, revise anything, but we should really be, in light of what’s occurred in COVID impacts in K-12, I think we should really be looking at what are some of the hard and fast admission criteria and stuff where they exist. Now, it’s true, like less selective institutions may just end up dealing with the majority of students who have experienced learning impacts, as they always have, but given the fact that even among top performers, there was learning loss evidence, I think we can’t, in any institution, sit back and say, well, it won’t be our problem. So what is within the realm of possibility to meet students where they are, which might be somewhat off of what we would hope. But if it’s not drastically off, for example, then at least we’re taking one step in the direction of meeting them. Because I don’t know how controversial that is. [LAUGHTER] I’m a data person, so from a data perspective, it is one of the few things that I see as a real possibility as you try to make those data points overlap.

Rebecca: So we focused a bit on STEM, if we broaden that a little bit to what universities can do. We talked about admissions criteria, are there other things that we should be thinking about to help our pipelines for all of our fields and disciplines and thinking about the future.

Peace: Yes. What can we do? There’s a sort of like current and then future tense implied by that question. What I would say is, we should have already been doing something. And the reason I say that is because “Okay, so we hear that there might have been some observable, pre-COVID developments on how prepared students were based on those pre-COVID assessment score declines.” So I would ask the question, “Was this not something that folks already were having to, in the margins, sort of deal with? And did they start doing something?” Because if so, do more. Look at the possibility that there should be a sustained, broader perspective. The other thing is that, prior to COVID, the rates of college enrollment, for example, among some of the previously lesser served student populations, Hispanic students, and two or more races, the rates of enrollment were really going up. So were colleges already having to address something about what had already been a changed student population, but for some reasons other than COVID. So again, if you hadn’t been, I think it’s really compelling, you’re going to have to now, but we can kind of maybe step back and say, “Well, what did we do?” Sometimes we forget, we were just dealing with stuff in the moment. And so if we look back, just go back to prior to 2020, and then start thinking about, “Oh, what have we tweaked over there or something,” if that was happening, that would give evidence of what you might consider doing now. Because you might have already been making some adjustments, You might have been piloting some things, you might have only been piloting them with the expectation that it wasn’t something that needed to go full scale, see if they’re there, and approach it from that perspective. As regards to helping students with academic preparation needs, it’s a different situation, but it overlaps with the topic of other types of student supports, because student attention, even if they have the aptitude, might be missing some of the content knowledge. But if they have the aptitude, if their attention is distracted from not only the perennial sorts of things, that some students have to deal with, work demands or lesser educational advantages of many different perspectives. Now, they also might have that academic learning loss, that if we do put some of that supportive environment in place, then could you, STEM or otherwise, meet students at a slightly lower bar, and then still get them successfully where they need to be. We’ve been trying to do that for different student populations for a while, but some of the data would suggest just do more of the same, and until something comes, for example, K-12 data about what to expect with incoming freshmen, expect to sustain it is what I would say. I listened to some of the podcasts that you pointed me to from previous episodes. And I will say one that really resonated with me was the one about relationship-rich education. And then there were several other ones, each of which really kind of touched on various aspects. But I think that relationship-rich education episode, it was specific sorts of interventions, a lot of which, as it suggests, are not specific academic intervention. But they’re the things that we are creating learning spaces, and whether we mean them to be punitive or not, they can be sensed as punitive for students who just really had a difficult four or five years, that about they’re sensitive, so to speak. But to be intentional about learning environments, that don’t take a lot of specific kind of empirically vetted interventions even but intentionality about airing some of this, I would say, with students, like if it can be a discussion point, and you have students who are really feeling the spotlight is going to be on them because it felt like it was really hard to get through my senior year and now I’m going to give this a go. And I know it’s supposed to be challenging and stuff, but maybe they know what part of their senior year or math class was the most difficult for them, if they’re given the space to kind of articulate these sorts of things, it doesn’t have to be in an open discussion forum in a classroom, maybe not, depending on what you need to talk about. But just making it clear to students that they can actually identify some of those needs, that they will be required to be the most responsible for their own learning, but even though we’re going to keep emphasizing standards, and do everything, that we actually do mean to support them, and that we see their success in our best interest, and therefore we’re open to listening, to hearing, to believing what they say. So I would say believe it. On a spectrum, there will always be some people who are maybe struggling the most or otherwise, we would maybe take a general approach that anyone who’s saying some of this is complaining. I would say the evidence would suggest believe [LAUGHTER] that whether we thought it should have been easier for the kids, it impacted them. And so believe it and open up the possibility that if they say what they need, they might be able to identify something for us to do, it could be far simpler and smaller. Some of it can be more time consuming, but maybe if it just becomes common practice to imbue our classrooms with this sense. Students themselves can support each other, that we can hear what they say they need to support them, and it might not be half of the things that we’re worried to mention out loud because we can’t promise it. It’s nothing brilliant, I apologize. And I wouldn’t be the person to speak to in instructional sorts of research, but it definitely resonates with these academic impacts as a result of something that was a societal experience, that we need to be in the space, not just of academics, but of what part of learning methods actually are important for learners. And I’m an adult educator. I have been an adult educator. I wonder, because when I listened to some things that are more about like instructional approaches for equity and for other sorts of things for adult learners, and just what I know about the science of adult learners is I wonder if some extent, this current, quote unquote, generation… I don’t know if it’s an entire generation, but certainly, maybe 10 years worth of students… have actually had adultified in ways that maybe bring them into a space where some of the methodologies that we use in our learning environments, we might learn something from actually thinking about those adult learning and education methods. I think to have to grapple with some of the things that some students, that the entire spectrum of students, it wasn’t just pockets of students have had to deal with, maybe they’ve adultified in some ways, and then yet are not showing it because they don’t have the skills they need from school, I might advise if people kind of consult with what are some things that would be different in an adult kind of focused classroom compared to some of the classrooms that are more typically going to be populated by younger students. There might be some methods there that they can be common sense, but they’re not obvious.

John: One other topic that has come up recently is that colleges were a little bit more flexible during the pandemic in terms of dealing with things like administrative holds, and so forth. Many colleges are starting to put those back in. And one of the implications of that is that students may not be able to register for classes at the start of the term and they may be coming into classes after other students have already been in a class for a while. And I’ve seen that myself this semester, in a way I haven’t seen it since COVID. Is that something that colleges perhaps should be a little bit more careful with?

Peace: For reasons that probably don’t have to do with COVID or anything… but yes, as most things go with COVID, it just amplified possibly. I’d say yes. So on an entirely different sort of research project that I’ve recently worked with, WICHE, my organization, led a action research study of sorts with 12 public colleges and universities. And they each did their own comprehensive data analysis on this topic of every single possible hold a student could get. I mean, it would be a registration hold, like limiting their registration, or maybe access to records or something, but it could be for academic probation, and it could be for paperwork of any sort, it could be for financial aid administration, advising holds that restrict registration. They went comprehensive, they dug deep. And in the first post-COVID academic year, which was 2021-2022, by which I mean, mostly removed from the funding supplements, more than 265,000 holds were placed on roughly 125,000 students across those 12 institutions. And there is wide variation across institutions on per student rates, and stuff like that, and the reasons for them and the observed outcomes that they appear to be having on even just the next-term persistence for students. But by and large, every single institution, we’re able to, by looking at the data, find certain segments of students, part time, certain colleges and disciplines that really needed some attention for what’s a wide-scale, maybe not problem, but certainly a wide-scale sort of thing that each of the institutions would say they didn’t know how to control it. One University, for example, found that a single academic department and this, of course relates to our faculty listeners, place the bulk of all the advising holds, and a significantly higher rate per student than any other academic department or college. And it turned out that these advising holes were well intended, had developed over time as a way to manage the major requirements. But the college never got a bird’s eye view of the whole picture about how they were just sort of being administered. So when the research team at that university brought the data to the Dean, the Dean immediately recognized the holds were not operating as they were intended and took action to substantially revise how they were used. That’s advising holds, and that’s one of the most frequently used type of holds, even though financial holds get a lot of attention for the right reasons. Institutions from those 12 are also reconsidering the exact timing of registration holds within a semester in case that they’re just being too preemptive. Like, it’s easy to just be like “Mark all XYZ-term students not to be able to register until advising” and what have you. I mean, it’s cost effective, it’s kind of solution at scale, if you will. One institution experimented giving a small cohort of students, those who are at risk of academic probation, the ability to actually register at the usual time during the semester with all other students. And then they only denied the registration at very end of the semester for the very small portion actually, even from those students who were still failing. And that small experiment for that university indicated that there wasn’t a difference and no benefit from preemptively limiting registration for the whole swath of students. So why not consider changing that? …especially if unknown, some of those students might have otherwise been impeded. And I want to really mention that this is for everyone, because you, in your seat, you don’t know what other holds are being used around the institution. So any given student is not only receiving the results of the one that you’re using for the right purposes, I’m sure, but they’re receiving any number of these. And if you dial back and see the full scope, often, at least at first glance, you got like low-hanging fruit all over the place that you can reduce them. There was repeated evidence in this study that some registration holds actually did the opposite of what they’re supposed to do, or intended to do, which was to advise students so that they would take the courses that they needed. So then we heard from students, and then some of the evidence that institutions started investigating, that the mere fact of not allowing the students to register during the peak registration period when other students were competing for classes, led them to register late and take classes they don’t need. I mean, they were going to take credits anyway. And could that actual hold be the reason that they end up taking and paying for these courses that they don’t need? Now, we know that’s not what we intended, we intended that they’re taking the right courses, so there are just different way to arrive at that. And then finally, on this topic, the FAFSA… well, I’m going to have to use the word that I see in the press, it’s not my opinion… mess, that I think we need to be ready, at least in this coming fall term, that there will be students and they would be students who have financial aid, who may experience untold, even if they’ve made it through the process they choose to enroll, they could face untold additional ripple effects, one of which is that holds on records and registration are part of the financial aid administration process, so if that has been delayed, and God knows what kind of other sorts of messes have accumulated in that space, if summer is the period during which most of this should be resolved, but students may not be engaging, definitely not as be accessible during summer, I think we need to be ready. And this includes even faculty being aware of what might be happening, or something you don’t know about a given student is struggling with just something like a paperwork mess that’s distracting from their studies. It’s distracting from their attendance and what have you. The more aware we are that could be happening, and it’s told even just through the data with holds, I think it’s just one of those things to be like, why not be that aware? Why not put it out there and be like, “If something other than your coursework, for example, even your financial aid administration after a kind of rough… you know, whatever, say the right words, to characterize it… please let me know so that I can be aware and you can move past that sort of thing.” These things that just add up and distract students who might otherwise be capable in the academic content. So just a lot of different things, honestly, about administrative processes, that really well intentioned, and in many cases can be proven to help support students in that, but just the administration of them, in this case it’s evidence through like holds, needs to be revised continually and kind of perpetually revised, because at the very least, each of the institutions and it wasn’t just these 12 I mean, research by the American Association of collegiate Registrars (AACRAO), and then also ITHAKA S+R had done some research on the topic, just revealing the scope of those administrative processes. Administrative processes should not be almost like a second admissions requirement for students, if they’ve been academically admitted, they shouldn’t be derailed by having to decipher something that literally just may not be well managed, because it’s accumulated over time.

John: And we think that would disproportionately affect first-generation students, where parents are not giving them as much guidance, perhaps, in terms of navigating all those little hoops that they have to jump through.

Peace: Yes, one example here, we’ve got financial aid recipients, which are not just first-generation students. I am a first-generation college graduate. And I only know now what I didn’t know, and thank God, that kind of thing did not stop me because I can look back and go like, “Wow, that was decades ago.” What I would say is the experience that I had, and I may be the case study of one having been exposed to some of these findings with the holds, I as a parent will not stand for that. If I get wind of it with my kid when she goes to college. Whether I would or not, since she’ll have to manage her own affair and stuff like that. But she actually knows about it now too. And just that’s no more than I would stand for a lot of things with my health insurance that were giving me hassles or my paycheck or anything else that’s really super important to me. When it comes to the administration, this is not again, it’s not like pointing fingers or anything. Things just develop over time, and they need to be revised and revisited. Not least of which because you have a new generation of people, but also just because the computer gets buggy and all of a sudden it’s really standing in the way.

Rebecca: You’’ve given us lots to think about. Thanks so much for all the work that you do, Peace, and deciphering it for us as well.

John: We always end with the question. What’s next?

Peace: Well on an organizational news level, we’ll be planning to really see update of the high school graduate projections in the last quarter of this year, 2024. That’s a big huge thing, especially given what I’ve just revealed to you. It’s hard to make projections or predictions about anything, I still don’t feel very much on solid ground there. And you know, I just want to mention on a personal level, me here sitting in my office, not a faculty office in the outside world, so to speak. I’m just really being intentional nowadays, like, I never have been before about compassion with myself and my colleagues. If I had students it would be compassion with my students, because it just really feels like things… zs we know, again, we just had the Debbie Downer discussion… things have been pretty frantic for years now, and it doesn’t feel like there’s any end in sight, because we’ve got some things looming on the horizon. But I’ve been really noticing that a few moments of silence and reflection, like literally just a couple, two to three moments, it goes a long way to getting me further than the two or three hours of just unrelenting pounding away at work that I also end up doing, so I mention that. We have to be kind with ourselves, no matter what we’re doing, and with our colleagues, and I would advocate for that, the compassion and kindness, bringing that to the learning environments can really go a long way, I think.

Rebecca: That’s a really good reminder, when it feels like there’s so much work to be done for sure.

Peace: We can do it.

John: …and having data on incoming students can help prepare us for what’s to come. So thank you for your work on this.

Peace: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

338. Diversifying the Education Pipeline

Diversifying various fields and disciplines requires intentional work to create and support a pipeline of practitioners. In this episode, Laura Spenceley joins us to discuss specific initiatives to increase inclusion in the PK-12 sector. Laura is the Dean of the School of Education here at SUNY Oswego. She is an Impact Academy Fellow through the national non-profit organization Deans for Impact which works to strengthen and diversify the educator workforce.

Transcript

John: Diversifying various fields and disciplines requires intentional work to create and support a pipeline of practitioners. In this episode, we talk about specific initiatives to increase inclusion in the PK-12 sector

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Laura Spenceley. Laura is the Dean of the School of Education here at SUNY Oswego. She is an Impact Academy Fellow through the national non-profit organization Deans for Impact which works to strengthen and diversify the educator workforce. Welcome, Laura.

Laura: So great to be with you two today. I’m really excited for our conversation.

John: It’s overdue. We’re really happy to be talking to you today. And we’re talking to you from a new room which the School of Education has graciously loaned to us because we lost our old recording space, and we’re now able to keep the podcast going. So thank you.

Laura: You’re most welcome. And truly, I can’t think of a more symbiotic relationship between Tea for Teaching, the opportunity to host you here in the School of Education, and continue this great work and digging into pedagogy issues across the education continuum. And having you right here in-house makes a lot of sense.

John: Our teas today are:… Laura, are you drinking any tea?

Laura: I am not a tea drinker. But I do have a robust French roast in my mug today.

Rebecca: A popular flavor of tea, as we’ve noted multiple times here on the podcast. I have Hunan Jig today, John, I thought it was a good celebratory sounding tea.

John: And I have a spring cherry green tea in a brand new School of Education mug, which I just received today. Thank you.

Laura: You’re welcome.

Rebecca: In your role as the Dean of the School of Education, you’re involved in the entire P-20 pathway. The School of Education has received two large grants to help support students pursuing careers in education. Could you tell us a little bit about these grants?

Laura: I’m thrilled to talk more about these opportunities. And these two projects are our teacher opportunity core grant, that’s our TOC grant and our Cultivating Representation in School Psychology grant. Both of these grants are, as their name may imply, designed to help us recruit, support, retain and move through into careers, teachers and school psychologists from a wide range of backgrounds. It’s a well known fact across most educational spaces that folks who are delivering instruction or providing support services don’t always represent the constituent student populations with whom they work. And each of these programs are designed to 1. help ensure that we have a representative and diverse education workforce. But more importantly than that, they’re also designed to ensure that as we recruit and matriculate students into our teacher preparation programs and school psychology program, that we’re investing in those candidates along the way, recognizing that students from historically marginalized groups are often more likely to have challenges in persisting through their academic programs, both undergraduate and graduate. So each of these programs has some similar foundational elements. That includes financial support along the continuum of their educational program, again, undergraduate or graduate, support for things like transportation, professional development opportunities. And those professional development opportunities are really designed to empower our students from those historically marginalized or underrepresented spaces in their fields with contemporary activities that will help them address systemic discrepancies in schools. So making classrooms more responsive to the needs of the multicultural communities in which they reside, helping ensure that our future psychologists and educators have opportunities to work with people along the way that look like them, that share their lived experiences, and build that really continuum of care around their success. It’s also a great opportunity for us as educators, leaders, teachers, to be invested in those spaces with them and hearing from their mouths, what their challenges are, what their opportunities are in districts and really working to empower them for a career in education.

John: And the School of Education has always been engaged in working with students from all these marginalized groups that you’ve mentioned. What other types of support, though, have you been working on developing in the School of Ed for students who are first-gen students, Pell-eligible students, or from historically minoritized groups?

Laura: It’s a great question, John, and I’m so thankful to have the opportunity to chat about it because I think sometimes, as is human nature, we want to create responses or programming from a perspective of “all first gen-students might need this thing” or “all Pell-eligible students might need this thing” and we’ve been certainly sensitive to the realities that those populations experience, but also have tried to take a step back and take a more nuanced approach to that work. I’ve had the opportunity to be in the Dean’s position for about three years now. And when I came in the door, it was the year after the global pandemic. And so, so much of what we knew here on a college campus and in our P-12 spaces in the community had just been turned on its head. So when I came into the dean’s office, one of the things that was really important was to hear from our students, our candidates pursuing their degrees, what are the challenges that you’re experiencing? And I need to give a shout out to Dr. Nicole Brown, our director of our clinical practice and partnerships office, she really had this vision of surveying students, engaging in some listening sessions with those students. And we took the opportunity to deploy a survey about how students were experiencing their programs, but also the challenges that they were experiencing. And those data were humbling, to say the least. We learned back in 2021-22, about one in five of our students was having to make the choice between eating and paying for gas to get to their placements. About one in four of our students had to go without a meal at a certain point so that they would be able to engage. We recognize, and this was not a new problem, but just how challenging transportation to and from their clinical sites was becoming particularly in a time where we were very sensitive to being in enclosed spaces. And so we took that opportunity to reflect on the ways we weren’t just to use quotes, “utilizing the resources,” like our teacher opportunity core program, but to really recalibrate the way we were engaging with all students. And so what that looks like right now is we’ve really taken an approach to engage with our students from the time they’re prospective students all the way through graduation and career placement. And so what that has looked like is we’ve had active faculty and administrator presence at recruitment events, helping prospective students and their families understand not just the phenomenal financial aid resources available to them, but demystifying grant programs like the Teach Grant program, like public service loan forgiveness, which is available to many of our graduates after a period of time, it’s also about helping those families understand what contemporary classrooms and contemporary educational careers look like. There’s so much animus in public media and in the dialogue around what’s going on in schools and giving our prospective students the opportunity to hear from our current students and our partners, what they can actually expect, not just out of their degree program, but the field, has been really impactful. On a more nuanced level, as a result of that survey, we have utilized a range of resources to help offset some of those specific concerns regarding transportation, costs related to certification, and food instability. I do need to call out our amazing student affairs team on campus that has made enormous investments in this space as well. And I think always connecting students to the most local resources has been a really effective way to ensure they can take advantage of those supports in a way that makes sense to them. For us, I was lucky enough to inherit a 12-passenger van that had been purchased right before the pandemic, and we’ve taken the opportunity to hire student drivers. We offer daily routes to and from the Syracuse area at no cost to our students, leveraging the generosity of our alumni and donors who have invested in the School of Education, we have made a commitment for any candidate that needs to get to or from their site and can’t use the van, that we’ve created an Uber voucher system. And so we’ve been able to put those funds directly in front of students. We’ve expanded our supports for certification exams and fingerprinting through really simply asking students: “Are these barriers?” and creating a process again, through our foundation funds, that we’ve been able to offset those costs in time of need. And then lastly, I think another part of this is helping our faculty understand the realities that our candidates are experiencing as they move through their degree programs. Bringing those data back from not just the survey but listening sessions we continue to offer as an open forum for students to share their concerns, bringing that back to our faculty and helping them understand in both a formative and accurate sort of way, what the experiences of our students are in looking to make changes, whether it’s to our core sequences, the way that we administer fees, encouraging open-access resources, building resource libraries within our departments, so that we can continue to wrap our arms around students, give them a great experience, and also ensure that something like a meal isn’t getting in the way of their ability to get to and from their site.

John: And one thing we should note is that Syracuse is about 40 miles or so from here. So the commute time for a student would probably be about 45 minutes to 55 minutes, depending on where the school is located. So transportation would be relatively expensive for students.

Laura: Yes, and it’s such a good point to make, and I know we’re likely to talk about partnerships later, being where we are here in Oswego, we are lucky enough to have amazing partners along the I-81 corridor from Syracuse to Oswego, almost to Utica, almost to Rochester. And so it is not unusual that our candidates are driving up to an hour each way. So absolutely.

Rebecca: And it’s a problem that campuses that are in a more rural context experience when they’re doing any kind of placements, whether it’s internships, student teaching, or service learning, or anything like that. It’s very different than an urban context.

Laura: Absolutely. And I think we’re really committed, we embrace the idea that we are a rural educator preparation program, while also embracing the fact we have large urban partners just down the road. And we see that as an opportunity to diversify our candidates’ experience and give them a broad sampling of school structures, organizations, what’s possible, both in large districts, small and the in-betweens. And so that’s been a really critical part of our preparation framework for many, many years here in the School of Education.

Rebecca: It’s always great to hear stories, and we’ve heard more of these since COVID, of schools really paying attention to the actual needs of students and what barriers they’re facing, and really being responsive to them and finding ways to solve the barriers that they’re facing. Because often, the barriers are great, but often there are solutions that we can put into place that aren’t actually that complicated when we get down to what they are.

Laura: Rebecca, I love so much how you framed that, because one of the driving mantras that I often remind myself is we can solve problems if we choose to. And I think to solve problems, we need to be able to describe the problem, we need to understand it from a compassionate perspective. Recognizing every candidate that declares a School of Ed major sees themselves as a future educator in one form or another, and partnering with them, to actualize that vision is the best part of my job.

Rebecca: Well, and we would hope they want to do the same thing for their students. So modeling what we’re hoping to bring into the land of education is certainly a good place to be. We talked before COVID, with the School of Education about some of the really great partnerships you all have both locally and regionally, both as school districts and community organizations. Can you talk a little bit more about some of the outreach you’re continuing to do in those spaces?

Laura: Absolutely. And frankly, we would not be a school of education without partners. Every program housed within the School of Ed requires an applied learning experience. And so even our non-teacher preparation programs in counseling psychology and management programs require some sort of applied experience. And so strong relationships and a strong understanding of the context for our partners is really important to our success and our candidates’ success. So I’ll talk about a few examples since there are many day to day here in the School of Education. For context, in 2020-23, for example, we placed more than 1000 candidates across I believe 246 different settings, kindergarten all the way up through high school. Don’t quote me on the number, but I think I’m close. But we have made a couple of purposeful efforts over the last few years. And in particular around our professional development schools. These are schools where we have an agreement to focus professional development activities for our pre-service teachers, in-service teachers, so folks who are classroom teachers in that district, and align that with our faculty areas of expertise to create what are called that third space for learning, where we were bringing in a range of expertise and perspectives. Here in Oswego County, we have professional development school partnerships with six of our nine local districts. And those partnerships have focused on strengthening support for technology and STEM-oriented initiatives at the junior high and high school level. In another district, it’s included a dedicated focus on early elementary school literacy outcomes and improving the way we’re preparing kids to read and write. Other districts have focused on more systems-level change with strengthening the way that we identify students who are struggling before that becomes a significant impediment to their learning, and organizing teacher and leader responses to ensure that those processes are unbiased, that we’re making decisions that help us put resources around what kids need to thrive. But that’s just a sampling of the types of partnerships that we have with local districts. I think, given the fact that education continues to be a domain where the public dialogue is not always framed as positive, partnerships with our local practitioners and districts, give us opportunities to 1. change that narrative and help people in our communities understand the value that schools can bring to that community. And Rebecca, you mentioned the way that, coming through the pandemic, schools are really regarded as kind of community centers. And I think we’ve seen those types of initiatives be really effective, whether that is including opportunities for families to access medical care, dental care, social services and supports when they’re in district, we have something to offer to that conversation because of the range of our preparation programs here on campus. And so we really tried to engage with our partners in the P-12 sector to ensure that we are operating as a true continuum of care for our communities.

John: During the pandemic, there were some fairly substantial learning losses that disproportionately affected students from low-income households, and low-income school districts. And a study was just released by WICHE in February of 2024, which found that those learning losses are still persisting, which means the students who are teaching in schools are going to face students with a fairly wide variance in their prior preparation. What types of things do you do to help prepare students to address the diversity of student backgrounds in terms of how much they come into the classes with?

Laura: Coming through the pandemic, one of the things we were reminded of was the power of a direct positive relationship between a student and an adult in the building, that can look like a wide range of folks, coaches, teachers, mentors, administrators, volunteers. But that’s something we have continued to embed in our curriculum and helping our candidates understand that day to day, the way that we make students feel is often the thing that will be really critical and helping ensure that they walk through the door the next morning, the next day, or ask for help when they’re having a tough situation. And so empowering our students to respect the dignity of people’s lived experiences, we embed before they move into their clinical experiences in schools, quite a bit of reflection, self-reflection on their own lived experiences, what education has meant for them, the spaces where they have been privileged or perhaps oppressed through educational structures, protocols or policies, and building that capacity of our students to both identify and address bias or embedded bias in the spaces where they work. Getting down into the curricular focus, it is frankly staggering to see how children have been impacted, particularly in the early elementary levels and the older adolescence ages when we think about both academic skills, but socioemotional skills, wellbeing, and I think one of the things that I try to celebrate is the resilience that’s been built into this generation of learners. On the other hand, that comes with a certain amount of exhaustion, anxiety, uncertainty about their future, and so coming back to that element of relationship building, it’s so key. At the curricular level, there is an enormous focus here in New York on the ways that we can do a better job in preparing children to be literate, contributing members of a just society. So right now in New York, there’s a lot of focus on the science of reading. And I want to be really clear to listeners, the science of reading isn’t about a curriculum, it is about embracing the empirical evidence towards a systemic approach to the instruction of reading, writing, and literacy across grades. There’s an enormous amount of energy around this work right now recognizing that we can do better in preparing kids to be literate. And I’m starting to see an equal attention to a focus on math and frankly, STEM preparation. Here in our community in central New York industry has returned with a bang. And there are wonderful opportunities for employment for students with a wide range of educational experiences starting right out of high school for gainful and lifelong employment in these sectors. But what we’ve heard is that math proficiency is often a barrier for those students. And so trying to incorporate elements of curiosity and creativity, bringing science, technology, and math into creative spaces, like art, design, dance, helping students understand that math and science, quite frankly, isn’t just about memorizing equations, or knowing your multiplication tables. But there are a range of application of math, science in our day-to-day lives. When I think about when I was a kid, we had a great lesson on fractals, and we went outside and we found fractals in nature. I remember it to this day, almost like it was yesterday, trying to engage students in their learning, that incorporates their lived experiences, having access to textbooks, readings that reflect their family structures, their linguistic background, the realities of their lives. And so our students ,when they move into those first teaching positions, carrying with them that, I’ll go back to respect for the dignity of all persons, that recognition that kids carry much more with them into a classroom than a backpack, and finding ways that we can empower their learning not just through curriculum, but through curriculum that is delivered at their level, that celebrates individual students growth, that isn’t anchored in some specific outcome, but recognizes individual student’ s growth as meaningful. And I’m really proud to say our data suggests our students do move into their first teaching careers with those skills. And I think the next phase of the conversation starts to focus on how can we, as an educator preparation program, be part of the community in delivering professional development? How can we bring the great work that’s going on in schools to our faculty and have that kind of recursive flow of information, and also ensuring that we are preparing school leaders to create conditions that help us achieve all of these goals. And with our programming here in the School of Education, we’re uniquely positioned because we offer those range of preparation programs and have the luxury of great relationships with partners.

Rebecca: We’ve talked a little bit about learning losses in K-12. But obviously, that has an impact on our college students as well. They also survived the pandemic and are here. What are some of the things that your faculty are doing to help these candidates feel like they have what they need to go into the community having maybe had some experiences of remote learning or challenges with some of these subjects too?

Laura: This is a really important question. And I think it’s one I’ll both answer from the school of education perspective, but also the broader campus perspective, frankly, because we don’t do this work in a vacuum or in a silo. And so I’ll pick up on some of the elements of the last answer, which is making sure that we on campus are framing the opportunity to serve our students as a positive one. We have an opportunity to meet students where they are and that will look different for different students. On the other hand, I think our faculty have been eager to try to crack this code, so to speak, on bridging our lived experiences in K through 12 and transition to college through the framework of the contemporary student experience and those are not parallel for many of us or really even comparable. I have been trying to, as dean of the school, make sure that we are approaching this from a perspective of strength. What students do come to us with us is a resilience that students of prior generations may not have. They come to us with skills and knowledge of technology and how to leverage it in a way that students didn’t in the past. And frankly, it was because they had to learn how to use that technology. Students coming to our campus today have access to more information at their fingertips than any generation of student has ever had in the past. And where we have opportunities is to help students both identify where they may have gaps, whether in their knowledge or experience, put those experiences in front of our candidates, and also help them navigate this world where it’s not always easy to identify what is good information and bad information. Now, let’s drill into some more specific examples there. I think one of the most critical things that we have done in the last few years and again, I’ll give kudos where they’re due to our student orientation groups. We have been embedding ourselves into some of those opening week sessions, where we’ve had the opportunity to talk to our future majors and undeclared students around college- level expectations. And while that might sound silly, I think when students can hear from us, from me, from my faculty colleagues, our stories that many of us are first-gen, were Pell-eligible, have student loans, worked while we were in college, struggled to purchase textbooks, come from different backgrounds, are new to the state or the country. I think that goes a long way as a formative first step in building that trust in the relationship with our candidates. It also gives us the opportunity to begin to plant those seeds around what supports are available to them. Whether that is to help them address their mental and physical health needs, their academic needs through our tutoring center, our office of learning services, the embedded tutoring services, and also come to see us as people that are here to help support them and what their vision for their success looks like. I had a young person come up at the end of our first orientation and said, “I’ve never had someone like you say, you walked in the same path as I have.” And it was really a moment where I understood that coming to the table and being authentic with our students is so critical at this point. The other piece of it, John and Rebecca, is recalibrating the way that we orient our classrooms to continue to give students frameworks for utilizing technology and AI and the wide range of information, also helping them become critical consumers of that information, providing formative feedback to their assignments in real time, flipping our classrooms and allowing students to lead the conversation. I think providing choice as much as possible around what literature students choose to present in classes, for example, have been ways that we have said to students, both overtly and more discreetly, you matter, your story matters and you and my classroom matters. I’ll also share we have been taking a look at the way we offer our curriculum to try to identify, and again as part of a larger campus focus on retention and success for our first-year students, where are the pain points, so to speak, in their degree program, particularly for transfer students, we’ve heard that there isn’t always as seamless of a transition to campus as we may assume. And so really starting to tackle some changes in our course sequence to ensure that our academic programs are set up in a structured sequential way that also gives enough flexibility for students to pursue some of their areas of interest, be student athletes ,be club leaders, or frankly, support their family, which many of our students need to do.

John: Recently, we’ve seen a lot of attacks on education at all levels, with books being banned in the classroom, removed from libraries, and restrictions on the types of topics and the types of history that can be taught in classes. What are some of the things that you do in the School of Education to help prepare students for a world in which they may be facing more challenges from parents and political pressures?

Laura: This is a critically important question and will be critically important action. I hope I could say in the next year, but I have a feeling this will be a long road. Too often I hear colleagues, neighbors, friends say, “Well, Laura, at least we’re in New York, you don’t have to deal with this in the same way.” And while it is true, I am proud to be in a state that has been very overt about people’s lived experience, respecting the civil rights of all persons here in the state. It is also the case that that can change very quickly in an election cycle. And frankly, we have seen that across the country. I’m particularly concerned right now about the way that civil rights discussions have been framed. And there are some cases in litigation right now around bullying initiatives and carving out exclusions or exceptions in those bullying protocols or policies that would allow, for example, trans students to be targeted without recourse. We see that replicated in both sports spaces, but also classroom spaces. I’m deeply troubled that this is a place that we’re going in a country that was frankly built upon public education and access. And we haven’t always gotten that access piece right. Many of our school policies and procedures have been built on an exclusionary clause rather than an inclusionary mission. On the other hand, we’ve made such great gains over the last 10 to 20 years in ensuring that schools are more responsive, supportive, dignifying places. I’m really troubled by this work. For our students, we have a commitment to social justice embedded in the framework of the School of Education. And that is more than transactional or it goes beyond the words social justice. Our curriculum prior to students going into schools is focused on those ways that schools have been exclusive spaces, have not always dignified the realities of the people who walk through the doors. And so for our students, what we tried to do is help them understand the threats or attacks on people’s civil rights or their histories is not new. On the other hand, it’s taken a very different tone in the way that it’s being implemented. So 1., it’s giving them the tools in knowledge and understanding of history to understand schools don’t have to be exclusive places, schools can be responsive, welcoming, encouraging spaces for all students from all backgrounds. It’s also about helping students understand that I want to be a teacher, I don’t want to be a politician is not a reality in which they will live as an educator. We try to empower them without encouraging them to engage in any particular behavior, to stay attuned to the realities of how legislative efforts, school board votes, and other sorts of community oriented book bans and dialogues might impact their ability to teach a particular lesson, utilize a particular academic resource. So you may have seen coming out of Florida, among other things in the last few weeks, a school district teacher had thought that it was prudent to send home a permission slip to alert the parents, that their children were going to be exposed to a black author. It wasn’t about the content of the book, it was simply the fact that they were going to be reading a book from an African- American author. I can’t think of a better example to highlight the importance that an apolitical stance is not one that classroom teachers can take, that school leaders can take. And that’s not about voting for a particular person or a particular party. But it is standing up to ensure as educational experts who have preparation, expertise, and insights that the community may not, to share them and be vocal about the ways that diverse learning materials, accurate historical representations of the world are critical towards ensuring that we do not replicate them. And so I am both incredibly disheartened at the turn that this discourse has taken. I’m also incredibly optimistic when I look at how young people, how educators, how experts have shown up and linked arms to say: “This is not right. We are not going to correct the wrongs of our history by limiting access to that history or by building smaller tables with fewer voices.” And so I tried to stay in that headspace as much as possible.

Rebecca: Definitely some good reminders and things for all of us to be thinking about in our role as educators. So we always ramp up by asking what’s next?

Laura: I love that question, because I could probably read you a laundry list of the things that we’re thinking about in our School of Education. Right now, here in New York, there’s a lot of robust conversation around, what does a high-quality teacher look like? What are they ready to do in their classrooms? And there’s a lot of engagement there. And again, this relates to helping the public understand not just what we do day to day or what the outcomes are, but the opportunity space towards preparing children for lifetimes of success. Here in the School of Education, we’ve got a range of new programs that we’re lifting in the fall of 2024, including our new master’s degree in behavioral health and wellness. And frankly, I think we have a range of new programs. As we talked about industry thriving here in central New York. There’s also a lot of energy in the school of education around our career and technical educator preparation programs, and of course, our technology education programs, some great investments in our lab spaces, looking at opportunities to do more in partnership in and with local districts to ensure, as we were talking about kids across Oswego County, have great opportunities to engage with science and technology and math in ways that bring them out of the classroom and into the world and creative spaces. So I’m really excited to see what the year ahead is going to look like for us.

Rebecca: Well, thank you so much for joining us, Dean Spenceley and for our wonderful space.

John: …and we’ll be talking to you much more in the future.

Laura: I look forward to the opportunity. Thank you both.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

337. Pre-College Programs

The transition from high school to college can be challenging for many students. In this episode, Sally Starrfield joins us to discuss the role pre-college programs can play in preparing students for college. Sally is a traveling Corporate Facilitator as well as an HR and Educational Consultant based in Durham, NC. She consults with precolleges to create revenue streams and identify courses and faculty that are appealing to academically curious middle and high school students. She has worked in a variety of instructional and administrative roles in North Carolina public schools. She designed professional development curriculum and provides career counseling for seasonal employees at Duke University. Sally served as the Assistant Director of Academic Affairs at the Duke University Talent Identification Program from 2009 to 2018 and then worked as an HR Specialist, Assistant Director, and then the Director of precollege programs at Duke University from 2019 through 2023.

Show Notes

Transcript

John: The transition from high school to college can be challenging for many students. In this episode, we discuss the role pre-college programs can play in preparing students for college.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Sally Starrfield. Sally is a traveling Corporate Facilitator as well as an HR and Educational Consultant based in Durham, NC. She consults with precolleges to create revenue streams and identify courses and faculty that are appealing to academically curious middle and high school students. She has worked in a variety of instructional and administrative roles in North Carolina public schools. She designed professional development curriculum and provides career counseling for seasonal employees at Duke University. Sally served as the Assistant Director of Academic Affairs at the Duke University Talent Identification Program from 2009 to 2018 and then worked as an HR Specialist, Assistant Director, and then the Director of precollege programs at Duke University from 2019 through 2023.
Welcome, Sally.

Sally: Thank you, John. Good to see you. Hi, Rebecca.

Rebecca: Hi.Today’s teas are:… Sally, are you drinking some tea with us today?

Sally: I am. I am drinking Mandarin ginger on this cold day in North Carolina.

Rebecca: Nice. I was just thinking it was like a heatwave here. I walked outside in the nice sunshine.

John: Yes, and the temperature here is I think was about 19 when I came on campus this morning as part of that heatwave. But we did see this big yellow thing in the sky, which we hadn’t seen for a while, so that was kind of nice.

Rebecca: How about you, John? [LAUGHTER]

John: I am drinking ginger peach green tea today.

Rebecca: Nice, and I have a jasmine green.

John: I suppose that we should note that I met Sally through my work at the Talent Identification Program and then at pre-college programs. So we’ve invited you here today, Sally, to discuss the role that pre-college programs can play in helping prepare students for college. Most secondary and much college instruction is targeted at the average students in a class. And we’ve talked a lot in this podcast about those students who are not very well prepared by their schools for the academic challenges they will face in college. But might this also sometimes occur for students who are quote unquote, gifted and talented?

Sally: Absolutely. We all know that differentiating instruction for each student is difficult no matter if they are at one end of the academic spectrum or the other. We all know of those stories of highly gifted, curious, academically inclined individuals who are not successful in school. Oftentimes, school is not designed for kids who are really energized by one subject or one topic. A lot of times schools are designed to make adult pleasers out of kids from a young age: “Sit in this desk in this row for this amount of time until you are called on.” And that doesn’t work for all students, and especially as they get older, and they start to think for themselves and question for themselves. So we do have a lot of academically gifted students who fall through the cracks, and who just are not successful in regular schools. And we see with the burgeoning online schools and various options, a lot of those students are opting out of traditional schools. And that’s why pre-college programs are often a really good answer for some of that curiosity that they have intellectually, and without the pressure of grades that traditional schools require, as the gatekeeper to go on to the next grade, or that’s how success is defined, is by a grade,

Rebecca: Do some students become bored and perhaps just give up in the K-12 system?

Sally: Oh, yeah, absolutely, and John and I have talked about this. We have witnessed this multiple times through the years in programs with our summer students. And we also know of a very successful award-winning professor at a prestigious university who was one of those students when he was a kid and just barely getting through seventh grade and then came to an academically gifted program at Duke in the summer. And when his parents met with the instructor at the end of the summer, and the instructor was talking about how he was just one of the most gifted students and such a good leader and really took on the serious roles in the classroom of leading the other students and using the university library and using every resource the university had to further his curiosity and his intellectual drive. His mom repeated the name of the kid [LAUGHTER] and said “No, my son is usually the one who’s in trouble, who’s told to sit in his seat, and to not question authority.” And he was like, “Well, that doesn’t apply here. He used this opportunity to lead.” And so that changed his whole trajectory in school because his mom knew that he had the capability. And he went back to the school and she went back to the school and said, “We’ve got to do better for him. This traditional way is not working for him. When he is allowed to lead, when he is allowed to question and go deep into a subject, he can really be successful.” And we know that’s true for a lot of our gifted kids who get bored. What we know about gifted students is that they want to go in depth into a subject, not just the wide breadth. When they’re in traditional schools, they’re in a classroom for 45 minutes to maybe an hour and a half, maybe four classes to eight classes a day, depending on the school schedule. And when we’re looking at students in pre-college programs, they are in a class anywhere from three to maybe even six or seven hours a day, and it’s one subject. So they’re going into that depth and really learning and satisfying those intellectual questions that they have, those big questions that so many of our academically inclined students, maybe not students who are driven by grades, but students who want to know the answers to their burning academic curiosity.

John: One other thing that I’ve often observed is that there have been some students who were told they’re gifted and talented while they’re in K through 12, and they can just coast through their classes without really doing a lot of work, without really facing very much challenge. And many of them, when they come to college, get really surprised when they’re faced with their first really substantial challenge. Might that be another role for pre-college progams in just giving them this sort of challenge that they’ve never been exposed to, so that they learn strategies for dealing with that, and perhaps develop a bit more of a growth mindset? Because if they’ve been told all through their K through 12 career, that they’re just really bright and really talented, it’s really easy to get this fixed mindset. And then when they face their first challenging course, sometimes they just give up and disappear.

Sally: Absolutely.

John: Might pre-college programs be effective in giving students a challenge without them having to worry about grades, without them getting to a college class where they haven’t learned any of those strategies, and they might end up not doing so well in college?

Sally: Yes, absolutely. I think that one of the beautiful things about pre-college programs is most of them do not offer grades, there are some that are designed to give college credit. Those do have grades associated with them. Sometimes they are just pass/fail, but the majority of the programs for academically and intellectually gifted students and pre-college programs, they are for the sake of learning, they are for the sake of enrichment, based on courses that students want to take. And so, without that pressure of grades, learning for the sake of learning, it just frees up a lot of that emotional energy, that angsty-ness [LAUGHTER] that’s associated with high-pressure situations in schools and with parents, and all that tension is just gone when you’re learning for the sake of learning and when you’re with like-minded peers. But John, to your earlier point, yes, there are a lot of students who are often the smartest kid in their class, maybe even in their school, maybe even in their town. They’re used to winning the science fair. They’re used to winning the state spelling bee and things like that. And then they get to a pre-college program, and they say, “Oh, these are all the other kids [LAUGHTER] from the other States and around the world who are doing the same thing.” And it can be little fish in a big pond, as they say. And they can have impostor syndrome. And you and I have both seen this. There are some emotional response sometimes from the kids, and they’re like, “I’m not supposed to be here.” And so that challenge sometimes is disconcerting at first, but it is what all of us need. We don’t grow in our comfort zone. We grow when we’re challenged. And that’s true of our students as well.

Rebecca: In addition to maybe not having grades, what are some other ways that these kinds of programs provide some of that emotional support or that growth in that area?

Sally: Yeah, I think a lot of it starts with just being aware that like-minded people, your age-mates are not always your idea-mates. And we put kids in schools with kids who are just their age. And so when we put them in classes that they have selected, that they are interested in, and the kids are in an age range of maybe eight through 10th grade, and they’re all studying econometrics, which is not something they would study in most of their middle schools and high schools, or astronautical engineering, they are finding these like-minded peers, and they have these discussions that they couldn’t have in their regular schools with their peers. And also, the discussions are different with their instructors, and rather than what they would be in their regular schools with their teachers… who are trained teachers… but when we’re looking at our instructors, they’re subject matter experts, who most of them have taught on the college level, even if they’re graduate students, they’ve taught some undergraduate classes. If they’re faculty they are used to teaching undergrad or even graduate students. So that helps our students in pre-college programs as well.

Rebecca: I Imagine another aspect of these pre-college programs is living on a campus and living away from home. Can you talk about that aspect of the program and some of the transitions or learning that happens for students in that aspect as well.

Sally: Test driving college is a big part of a pre-college program. So even learning to do their laundry, living in a dorm, sharing a room with a roommate. Most pre-college programs, students do share a room with a roommate. And that’s where a lot of their learning and their growth comes from. Because sometimes they’re meeting people from another country. Most pre-college programs do attract a global audience. And so even for a lot of our students, just meeting kids from other states or kids with different interests, because the kids usually who are sharing a room, they are not always in the same class, and anywhere from 8 to 20 classes offered, depending on how large the program is, each term in a pre-college program. So yes, there’s a lot of exposure there. And we do replicate the college experience where they have office hours, so they can be with their instructors. And we encourage that. And so it’s that test drive of college that helps them be more prepared wherever they end up at university.

John: One of the big topics in higher ed, and we’ve been talking about it quite a bit on the podcast is the use of alternative grading approaches compared to the traditional grades with letter grades or numeric grades and so forth. And much of the discussion focuses on extrinsic versus intrinsic motivation. In the Duke TIP program, and the later pre-college program, how was learning generally assessed?

Sally: So, if your listeners haven’t listened to the Unessay episode that you all did, it’s my favorite episode, by far, because that was new information for a lot of people. Pre-college programs, they haven’t been calling it that unessay necessarily, but they’ve been doing alternative assessment for years. So in a pre-college program, that’s one week to three weeks long, there’s not a lot of turnaround time for grading and all that; there’s not a full semester. So it’s very rare to assign a traditional research paper. But the students have the same access. They have the Library, University librarians, and for our students, many of them have never been to a university library. And there’s this vast difference between a middle school and high school library and a university library. They have access to our laboratories, very often for the science classes, and to law libraries, for law classes, and courtrooms and things like that. So when they are in these real-life simulations, and often going out into the community to experience, for an architecture class, they usually end up going to an architectural firm and interviewing architects. So having these conversations, these interviews, working with librarians, working with people who are working in the field, working alongside doctors for modern medicine, disease, and immunology class using patient simulators that the med school students are using at the university, all of those things, that is learning and that can be assessed just with the students in office hours talking to their instructor, they can be assessed with their reflection journals at the end of the day. They can do presentations, and I’ve seen some really creative ones too. Kids make up a series of memes about their experience they had going to a water treatment plant for an environmental science class. So there’s no limit on the way to assess their learning. And especially when we’re looking at classes that are not for credit, they’re truly for enrichment. And make no mistake, it doesn’t mean that it’s less important in their academic career, or in their preparation for their professional careers and for their college career, because this deep seated yearning that they have to learn these topics often propel them to the success they later achieve in life. And John, you can tell so many stories about that, from your former Duke TIP students and Duke pre-college students who have gone on to do amazing things academically and career wise, and books they’ve written, and you stay in touch with a lot of your students. So the relationships and networking they’ve created.

John: We’ve had several of them on the podcast. I think our most frequent guest on the podcast was in one of the early cohorts at the Talent Identification Program before I started there. I didn’t start until 1987. But the first cohort was in 1981. And I also knew many of the other people from the early years because many of them came back on staff for several years. So I got to know quite a few people from the early cohorts as well as the students I worked with later. It’s a really impressive group of people.

Rebecca: I think it would be interesting to have John talk a little bit about his assessments and his classes too, because I know he’s done some really interesting things in the classes he’s taught.

John: Well, long before, there wasn’t even a term called on essays, I used to do the same thing in the TIP program, where I told students, they had this capstone project, and it could be in any format they want. And some of them did debates. Some of them wrote songs, they created a wide variety of ways of demonstrating their learning. And one of the things I had given them as an option, based on the Dance Your PhD competition was I said, “if you want, you could do some type of interpretive dance illustrating some concept.” And for several years, they didn’t take me up on that. But then for three years in a row students did, they wrote a song that they performed or sung, while they were doing the dance to illustrate some of the concepts they had learned. They had a lot of fun with that, and I recorded all those, and I let them share it with their parents, and so forth. More recently, I’ve been teaching in the pre-college program, which is a shorter program. So there’s not as much time to prepare such things. But students do presentations at the end, where they present their research, and parents are able to attend either in person if they’re picking up the child at the end of the term, or they can watch it over Zoom. So most of the parents were able to watch the students do their final presentations. And that’s something that both the students in the program and the parents have really enjoyed.

Rebecca: Such good examples, right?

Sally: And we have to remind your listeners that you’re talking about doing interpretive dances about economics and economic terms and econometrics. And so there’s just a creativity that the unessay, if we want to give it a label, allows for and the other thing that I think that these type of assessments do is, I think a lot of times in our traditional schools… and I say this as a career educator, I had started out as an English teacher, I was a literacy specialist, I was an assistant principal before I worked at Duke… and so I think that what we do is, in our efforts to be creative, we tell the kids “Oh, do a group project,” and we all have been in those group projects that are just absolutely terrible experiences. And they’re not about learning, and it’s just about getting through. But a lot of times we think, “Oh, this student, they can take on different roles, and they can work from their strengths.” And when we’re asking adolescents to work with other students who they may or may not [LAUGHTER] get along with, and that they’re still trying to figure out their own strengths. And then we’re putting them in these simulations. It can be really difficult and just kill the joy of learning. So I like the unessay and the non-traditional assignments for assessment, especially when students have the option to work individually, or to work with a group, but I am not a believer in forced group work for adolescents. We all do it in graduate school. I’m sure you have MBA students listening and I know what your life is like. And so it is all group work all the time for a lot of you. So we do want students to thrive individually in their assignments, and still allow creativity there.

Rebecca: So, programs like this are expensive. [LAUGHTER] What role do need-based scholarships play in offering some equitable access?

Sally: They are so expensive. And the majority of the expense is feeding and housing the students. And so for most of the programs more than 80% of the cost, and this can be $5,000 for a week sometimes. And that can be daunting to families, but more than 80% of that is feeding them and housing them. And remember, they have round-the-clock supervision. So there’s a lot of staffing that goes into it. So yes, having financial aid is essential. And most pre-college programs do have some sort of financial aid. And there are also community-based organizations that will often support students in their summer programs, and you can Google community-based organizations support for pre-college programs. And it just depends on the community you live in. Here in North Carolina and the Research Triangle Park area, some of our larger companies are tech companies, some of them are pharmaceutical companies, support students when they write and just ask for it. And they write essays about why they want to study at a pre-college. And also pre colleges, they’re associated with universities, usually, and so the universities have a vested interest in this as well. And they want students to want to go to their universities. And so sometimes there’s support from certain departments, a lot of times there is an endowment, especially if it’s a long running pre-college program. And so there are options for financial aid, and most of them offer, sometimes the term “scholarship” is used, but a lot of times “financial aid” is used. And I think a lot of people are surprised, I’m in touch with a lot of families who are surprised and like, “Oh, I think our family might make too much money.” But what they do is they look at this the way a lot of universities are looking at financial aid now, it’s depending on how many children you have, how many children you have in college. And so if you have a family two to more children, and you already have a student in college, they’re often taking that into account and are able to provide at least partial financial aid often.

John: Both the TIP program and the pre-college programs primarily serve students with high levels of academic performance. Might students also benefit from pre-college programs targeted at first-gen students and students from school districts that are not well equipped to adequately prepare students for college-level work?

Sally: Absolutely. I will say that because students know going into a pre-college program, especially the ones where you’re taking one class for maybe six to eight hours a day, a minimum three hours a day, it’s pretty self selecting. It’s usually students who are very academically curious at least. And there are a lot of first-gen students who come through, a lot of them just need to be told about the opportunity. So maybe they haven’t learned about it from their siblings or their parents at home. But we have a due diligence as pre-college providers to make sure that we are talking to the guidance counselors, we are talking to the organizations that are working with first-gen students, that are working with students from less advantaged communities, socio-economically. And so, yes, there’s definitely a place for making sure that there is full access. And that starts with just making sure that our marketing materials are inclusive, they need to be inclusive. You will often find that there are people working in pre-colleges who will translate for parents. Our courses are taught in English here in the US in pre-college programs. But many pre-colleges have assistants for working with parents who their first language is not English, whether they’re based here in the US or globally. So yes, definitely, we want to have that replication of the college experience where students are meeting diverse people. And so that’s going to be socioeconomically and where they’re from.

Rebecca: So we’ve talked a little bit about potential enrollment funnels that might come out of pre-colleges, but what are some of the other benefits to colleges and universities for offering these pre-college programs in the first place?

Sally: So, highlighting what their strengths are and using their resources that they have. If they have an MBA school, and if they have…, I can think of one university that has a Bloomberg simulation center for stock market trading… and so highlighting, that students remember that, that’s just great advertising in what they offer, and getting it known to students from other parts of the country or parts of the world. But also a big benefit is the employment that can come for the university from this. Undergraduate students are needed to be teaching associates, they’re needed to be residential assistants in the dorms, they’re just essential to helping the pre-college students acclimate to the campus and showing them around, making them feel comfortable, making sure they’re safe. And having graduate students test drive their own teaching. And it’s really important for us to remember that many of the pre-college programs really focus heavily on STEM, and a lot of our graduate students have been research assistants, but a lot of them haven’t been to Asia. And so this is a good opportunity for them to be TAs, to then learn how to be instructors and most pre-college programs have a really strong pedagogical training, where they are bringing in the staff ahead of time, they are teaching them online before they come in, and doing a lot of professional development with them about teaching and pedagogy and assessment. So it can bring a lot of revenue to a university, it can bring a lot of jobs to the undergraduates, the graduate students, the faculty, postdocs, and so it’s quite the revenue arm for many universities.

John: And along the lines of graduate students and undergraduate students benefit. I’ve had quite a few students who were undergraduate students, sometimes from Oswego some were from other institutions, who, by working in the Talent Identification Program, were able to use that in the graduate applications, which increased their chances of getting teaching assistantships. I can think of at least six or seven of my former students who wrote that up in their applications and it certainly didn’t hurt their chances for being accepted and getting funding in grad school.

Sally: Yes, I often serve as a reference for our staff. And I was contacted by a prestigious law school, there was a student who was kind of on the bubble, but they looked at his experience working with pre-college students in the summer and how much he had done with mock trial simulations with the students, and that pushed him over the edge. And now he’s doing very well. And I think you and I both have seen him on CNN multiple times. John, I think you know who I’m talking about. So I know that there’s a lot of benefit from hiring undergrads through postdocs to work with pre-college students. And often some are hired from the university where the program is located. But most often they are brought in from across the country and sometimes from across the world. And that just adds to the richness of diversity for the program for the students. And it’s such a great networking opportunity for the employees of the program to learn about other people and their experiences within different subject area disciplines and what their university experiences have been.

Rebecca: So we’ve talked a lot about STEM programs, Sally, what about the humanities and the arts?

Sally: Yes. So when I started working with these programs in 2009, it was common to have a class on Shakespeare for a seventh grader. And remember that these classes, we want to make sure that pre-colleges are offering classes that they wouldn’t typically have access to in their regular schools. But as we have seen the STEM revolution, that’s what parents want to pay for. That’s what these pre- college programs are predominantly offering. And oftentimes when humanities and arts classes are offered, they don’t fill and they sometimes end up getting cancelled. And so we are looking at pre-colleges as revenue streams for universities, so they’re going to usually offer what parents are going to pay for and where the demand is. And so with the rise of STEAM, there were some arts classes and some humanities that were interwoven in with some of the science and technology. We have a long way to go there to go back to where we were even 20 years ago, to highlight the arts and humanities, and so we have to show value to the parents who are paying for it and to universities. We don’t always just offer the most popular classes, we can offer classes with a smaller number of students. And so just finding that balance is tricky.

Rebecca: And it’s a continuing problem in all of higher ed as well to continue to make the argument for arts and humanities and the importance that it has and the place that it has in our society.

Sally: Absolutely. And I think pre-college programs are a way to do this. Pre-college programs, we know can be funnels for university admissions. And so if we have a student get really excited about a theater program, or some arts or humanities course, they can end up pursuing that at a university. And so it’s definitely worth pursuing, I think, from a pre-college curriculum perspective, writing the curriculum for it, and from a university perspective of offering it.

Rebecca: So we always wrap up by asking: “what’s next?”

Sally: So what’s next, I just really believe in pre-college programs, because I know that they are life changing for so many students, and as many have told me, life saving for some. And so what I am doing now, as I am doing a lot of consultation work with different pre-colleges and looking at their goals, looking at ways that they can use their universities’ resources to create revenue streams, to create programs that are appealing to students, and also how they can partner with their admissions departments. Where do they want to highlight their strength as a university, as a college? And where are they being inclusive to these students so that they want to try it out for a summer and then possibly as their undergraduate experience? So yeah, my consultation work, my consulting, is really fun and having that experience from the education side and also from the HR side, makes it a really deep dive that’s rewarding.

Rebecca: Well, thanks so much for sharing a little bit about pre- college programs with us today.

John: Thank you, Sally. It’s always great talking to you.

Sally: Thanks, John. I’ve enjoyed our many many many summers together. Great to talk with you Rebecca you as well.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh Editing assistance by Ganesh.

[MUSIC]

335. The Abundant University

The cost and the benefit of investing in a college education have been increasingly questioned outside of the academy. In this episode, Michael D. Smith joins us to discuss whether the traditional college model can survive in a world in which technological change has expanded the possibilities of  alternative education and credentialing mechanisms.

Michael is the J. Erik Jonnson Professor of Information Technology at Carnegie Mellon University’s Heinz College of Public Policy and Management and the author of The Abundant University: Remaking Higher Education for a Digital World. He is also a co-author of Streaming, Sharing, Stealing: Big Data and the Future of Entertainment.

Show Notes

Transcript

John: The cost and the benefit of investing in a college education have been increasingly questioned outside of the academy. In this episode, we discuss whether the traditional college model can survive in a world in which technological change has expanded the possibilities of alternative education and credentialing mechanisms.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Michael D. Smith. Michael is the J. Erik Jonnson Professor of Information Technology at Carnegie Mellon University’s Heinz College of Public Policy and Management and the author of The Abundant University: Remaking Higher Education for a Digital World. He is also a co-author of Streaming, Sharing, Stealing: Big Data and the Future of Entertainment. Welcome, Michael.

Michael: It’s great to be here, John, Rebecca. Thanks for having me so much.

John: We’re really pleased that you could join us. Today’s teas are:… Michael, are you drinking tea?

Michael: I did earlier today, my wife makes this lovely herbal tea that you put in a little strainer. So I still have that in my memory. [LAUGHTER]

Rebecca: I haven’t English breakfast. I was a little bit on the go today. [LAUGHTER]

John: An unusual circumstance that has only happened, I believe, once before… I also have English breakfast. So this is twice so far out of 330 some episodes, I think, that we’ve been drinking the same tea.

Rebecca: It’s rare. We’re not exactly the same, yeah. [LAUGHTER]

Michael: Alright, what are the odds?

John: 100% today? [LAUGHTER]

Rebecca: Yeah. [LAUGHTER] So we invited you here today, Michael,to discuss The Abundant University? You note that the current system of higher education was created in an environment in which educational institutions provided access to scarce educational resources to a privileged few and the perceived quality of colleges and universities was judged primarily by their selectivity. Can you explain the role that scarcity has long played in the structure of higher ed?

Michael: Yeah, so we created a system of higher education in a particular time and with a particular set of technologies. Specifically, you need to sit in my class, if you’re going to hear me, and I think both our expectations about privilege, and our technologies have changed in ways that mean that we desperately need to change how we deliver higher education. So one of the things I talk about in the book is just if you look at what defines power, what defines market power in the university, it comes from being able to control access to the scarce seats in your classroom, being able to control access to the scarce faculty experts, whatever the heck that means. And then being able to control access to who gets the credential, the highly valuable credential, that’s going to help you rise in the work world. I think those things are starting to change in ways that we in higher education ought to wake up to.

John: One example that you use to illustrate the issue of scarcity involves Joyce Carol Oates. Could you describe this example for our listeners?

Michael: Joyce Carol Oates is a great example. She’s an absolute rock star. She’s written 60 different novels, she’s won a National Book Award, O. Henry awards, she’s been nominated for the Pulitzer, all these wonderful things. And so you’d think we’d want to get as many students exposed to Joyce Carol Oates and her knowledge as possible. The problem is within the existing system, to get exposed to Joyce Carol Oates, you’ve got to get admitted to Princeton, which has an acceptance rate of like 4%, then you’ve got to be able to pay the tuition at Princeton, which is without aid, something like $80,000 a year. And then, even if you do those first two things, you’ve got to get up at five in the morning and stand in a long line of students to get access to one of the 10 seats in Joyce Carol Oates’s class. So we’re taking this incredibly valuable resource and we’re making it incredibly scarce. Could we do better? Well, we are in some sense, because Joyce Carol Oates has a class on the streaming service Masterclass, where for 15 bucks a month you can get access to Joyce Carol Oates’s knowledge. Now is it the same as what you get at Princeton? No, but it’s better than nothing. My daughter and I sat and took the class together, and it’s actually quite good. And that’s the contrast between scarcity and abundance I’m trying to draw out in the book. Are there ways we can use technology to make resources that used to be scarce, abundant in ways that could benefit students?

John: And that scarcity made a lot of sense when it was one lecturer sitting in a seminar room or in a lecture hall running a class and there was no way of distributing that information more widely. Things have changed a little bit since then, haven’t they?

Michael: They’ve changed a little bit and I talk about in the book, there’s something kind of odd about the way we define expertise in universities and the way we distribute that expertise. So to get tenure, I had to become the world’s recognized expert, whatever that means, in this incredibly narrow part of my discipline. So my value to the university is: I’m a specialist. And that’s great, except when I teach I teach like a generalist. I teach all these different topics where Erik Brynjolfsson is the expert or Catherine Tucker is the expert or Natalia Lavina or Ed McFowland. Wouldn’t it be cool if you could learn that topic from them? We’ve never been able to do that because it’s hard to bring them into the classroom. But now, we can create that sort of experience in ways that I think could really benefit our students. One of the examples I talked about in the book is Anita Elberse at Harvard Business School and I have both studied a particular area and we actually disagree, our conclusions disagree. When I teach it, I’m pretty sure I’m giving short shrift to Anita’s position. Wouldn’t it be cool if you could bring both of us into the classroom and I give my position she gives her position and the students decide for themselves. We’ve never been able to do that. I think we can now.

Rebecca: …really pointing to how technology is offering the opportunity for more inclusion. And that’s certainly been a topic that’s been happening throughout higher ed with Inclusive pedagogy and topics about UDL and digital accessibility and things like this. But you point to a number of structural barriers that impede this from actually happening in higher ed generally. Can you talk about these barriers and what it would take to make them go away?

Michael: Yeah, this was one of the hardest parts about writing this book is sort of taking a cold, honest look at our business model, for lack of a better word. And when I was giving this talk in front of a particular audience, and somebody said, “Mike, all the research shows…” and they were right… “all the research shows that the best way to become wealthy later in life is to get a four-year college degree from an elite school, and so we should be encouraging students to do that.” I’m like, “yes, and no, you’re absolutely right, the best way to become wealthy is to get a four-year college degree from an elite school. The problem is, the best way to get a four-year degree from an elite school is to be wealthy.” And when you add those two things together, we’ve created this terrible feedback loop that just exacerbates social inequality. Now, you might say, “Why do I say being wealthy is key to getting a four-year degree from an elite school?” And in the book, I talk a lot about some of Raj Chetty’s research, which shows that kids born in the top 1% of the income distribution have a one in four chance of getting admitted to an elite school, top 80 school, kids born in the bottom 20% of the income distribution have a one in 300 chance of getting admitted to the same elite school. And so what I say to my friends who are economists is, “Hey, I’m trained as an economist too, I believe in the efficient allocation of scarce resources. If we in higher education genuinely believe that rich kids just happen to be 77 times more likely to be capable of an elite education than the system’s working fine. But if we don’t believe that, and I don’t know anyone who does, then this is a terrible way, a terribly unjust way of allocating access to the scarce resource.” I don’t mean to pick on Princeton, but let me pick on Princeton since we talked about Joyce Carol Oates. Princeton admits more students from the top 0.1% of the income distribution… families making more than $2 million a year… than the combined number of students they admit from the bottom 20% of the income distribution… families making less than $25,000 a year. Is that because Princeton is biased against the poor? I don’t think so. I think it’s because all of our incentives encourage us to make decisions that are highly correlated with wealth. And I could expand on that if you want, but one example I think a lot about and talk in the book about is Georgia State University in 2009, made some very intentional efforts to increase access to their campus, they ended up increasing the number of Pell-eligible students that they admitted from 32% to 60%, which meant they had three times more Pell-eligible students at Georgia State University than the entire Ivy League combined. So great news for access and inclusivity. The only problem is by doing that, they dropped 30 places in the US News and World Report rankings because their SATs scores, their alumni giving, all these other things, fell. The system is rewarding us for doing things that we all know are bad for society. And so a key part of the argument of the book is we’re not going to solve this by tweaking the existing system. We’re going to solve this by creating a new system that rewards people for inclusivity and diversity.

John: As you’ve just said, part of the issue is that all of the agents there are pursuing what’s rational for them. Their parents from high-income families spend a lot of resources in preparing for that. And we’ll include a link in the show notes to an earlier podcast we issued a few weeks back where we interviewed John Friedman, who is one of Raj Chetty’s co-authors on several of those studies. So we do address some of that in that podcast, and I encourage people to go back and listen to that if you haven’t seen that. But we have a system where it’s currently self-reinforcing, that institutions are doing what’s best for them, faculty are doing what’s best for them, and parents are doing the best they can, given the constraints that they’re facing. How are we going to get past those incentives to move to a more inclusive environment, or that would reward institutions for becoming more inclusive,

Michael: It’s going to be really hard within the existing system, I think there’s two options we’ve got. One is to rely on folks like Paul LeBlanc and Raj Chetty and Zvi Galil at Georgia Tech University, people who are willing to say, I want to create this, and I’m going to do it, even though I know it’s not aligned with my self interests, and I’m going to create a online educational experience, because I’m focused on the needs of my student base, rather than what the market is telling me to do. And I think that’s possible if we rediscover our mission. And the reason I say that is because you mentioned one of my previous books, and a lot of my previous research was about the entertainment industry and how technological change affected the entertainment industry. In looking at that, what I found really interesting is the industry initially opposed technological change, because they saw it, correctly, as a threat to their business model, their way of doing business. At some point, I had this really interesting conversation with a pretty senior creative person at one of the studios. And we were sitting in the lunch room, and he sort of leaned forward and quietly, so none of his colleagues could hear, said, “Mike, a year ago, we sold my show to Netflix, I want you to look at the season of my show that Netflix just put out, and you’re gonna see that it is in every way superior to what we did on the lot. The storytelling is better, the cinematography is better, and I just can’t figure it out.” They told themselves, the technology companies are going to make stuff that’s inferior than what we do, and what they were seeing with their own eyes, and not to mention at the award shows, the technology companies were actually making great entertainment. And I think it was that realization, where they said, “You know what, you’re right. Technology is a threat to my business model. But my mission is different than my model, my mission is creating great entertainment, and getting that entertainment in front of an audience. And my mission is so important to me, that I’m willing to blow up my model to pursue it.” I think that’s exactly what we’ve seen in entertainment. What’s the parallel here? What’s our mission in higher education, friends? if our mission is helping rich kids get a leg up in the job market, everything’s working just fine. But that’s not our mission. Our mission is helping people from all socio-economic backgrounds discover their talents, develop those talents, so they can use those talents to the benefit of society. I think we’re leaving a lot of people behind. And I would love for us to get excited about that mission, so excited that we’re willing to blow up the model.

Rebecca: We’re undergoing strategic planning at our institution. We’ve been having lots of interesting conversations about many of these things, actually, some of which are really inspiring to think about, like, what is the mission? If we’re really thinking about equity-informed student success, what are those metrics? How would we need to change how we’re looking at things to even know that we’ve achieved success? And what I’m hearing you talk about is there’s the difference between the institutional change that needs to happen, and then the broader machine of higher education. But when I think about cultural change, I think about bottom up and top down change. There’s regulation kind of change, but there’s also that grassroots change. And it’s almost like many institutions need to have this discovering independently to make some of that start happening. And force, bigger systematic change.

Michael: Yeah, I think we need bottom-up change in the sense of, I’m tired of being trapped in a system that forces me to make decisions to exclude people solely because they grew up in the wrong zip code. I think the other thing we need is some top-down change. And there what I talk about in the book is, back in the early 2010s, a lot of really smart, prominent people, including Clay Christensen, who I have a world of respect for, said that in 5 to 10 years colleges are going to be in real trouble, because we have this new technology. It’s 15 years later, that hasn’t happened. So I think a lot of people sort of roll their eyes when they hear technology is going to change our business. In the book, I try to argue, respectfully that I think part of the reason Clay Christensen was wrong, is he wasn’t using the right model of disruption. So his model says this technology comes in, and it’s going to create an inferior product and the incumbents are going to ignore it. What I’m trying to argue is that MOOCs and other online learning, if you think back to those three factors I talked about earlier, scarcity in the classroom scarcity in the experts, and scarcity in the credential. What online learning so far has done is its created abundance in who can get access and abundance to the faculty. What it hasn’t changed is the credential, the credential is still scarce. If you go to a Princeton or Harvard, or let me just eat my own dog food, Carnegie Mellon, people are going to assume you’re smarter than someone who went to a different school. What if we changed the way we did credentials? What if we would change the way we did credentials from this very brand-oriented credential that we have now to something that is closer to the student’s actual capabilities, actual skills? What the heck am I talking about? So the story I’ll tell is on my whiteboard as I was writing this paper, I had “brand” circled with a big question mark next to it. If the university brand name is the brand, how do you change the value of brand names? It’s really hard. So I’m scratching my head about this. And later that day, I was buying a really expensive scanner from a manufacturer I’d never heard of before, solely because it had a 4.9 star rating on Amazon and a bunch of really positive reviews. I was like, “Oh, crap, that’s how you change brand names. You add in objective information about the quality of the product.” I’ll stay in complete strangers’ homes, because they have a good rating on Airbnb, I’ll drive home with complete strangers, because they have a good rating on Uber. We see this in all these areas of society, could we bring that into the academy so that instead of judging people based on the name of their school, we start to judge them based on their actual skills? Wouldn’t that be cool. The other thing I’ll say, just to roll this out a little bit more is one of the things I think we’ve seen in these other areas of the economy is when you didn’t have the brand name, when you were an independent hotel no one had heard of, I’m going to assume you’ve got lousy rooms, and I’m gonna stay at the Hilton instead. Once we created a way to signal your quality, all of a sudden, a whole bunch of people who didn’t have the brand name had the incentives to invest in quality. We’ve got a whole bunch of places that aren’t Hilton, who are investing a lot in creating great room experiences. What’s the parallel? If we were to open up a way for students to signal their true skills, might we create a whole bunch of incentives for students to invest in those skills in ways that they just can’t right now, because I’m going to be judged based on the brand name of my school, instead of my actual knowledge?

John: Going back to the issue of markets, currently markets encourage institutions to maintain the scarcity. But they’re also subject to the Baumol disease of increasing relative costs, which is inherent in anything where labor is a major component of the production of the service. And with rising costs, while that maintains scarcity, it also opens up the market for other alternatives that can provide credentialing as an alternative to the traditional institutions. Could you talk a little bit about the Baumol disease and also perhaps, how that might encourage institutions to start shifting to other less expensive methods of credentialing?

Michael: Let me answer the second question first, and then come back to Baumol. Can we imagine ways that we could have new ways of credentialing students, and the example I used in the book is a guy named Gilberto Titericz. He worked for the Brazilian state oil company graduated from the 12th ranked Brazilian engineering college. And it just so happened in the evening, he liked to play around with Kaggle, which is an online place where you can go and provides awards for people to solve analytics challenges. And he got good enough that he had risen to the top of the worldwide leaderboard. And all of a sudden, Silicon Valley companies were recruiting him not because of his degree, not because of his work experience, not because of the GPA, but solely because they could see an objective signal that this guy’s really smart at analytics. I told this story to a buddy of mine who works in journalism, and he said, “You know what, Mike, I won’t hire anybody unless I can see their substack. I want to see if you can write. I don’t care if you graduated from Columbia’s journalism school, I want to know whether you can write.” And I think we’re seeing a lot of areas where you can have these signals. As an economist, it warms my heart that you would bring up Baumol’s cost disease. What Baumol’s cost disease says is that if every other sector of the economy is increasing productivity and economists define productivity as output divided by input. So you’re creating more output with less input. If you’re in a sector where every other sector is increasing productivity and your productivity isn’t changing, then your costs are naturally going to go up. And that’s very consistent with what we’ve seen in higher education. We’ve seen over the last 60 years, prices in higher education have increased at four times the rate of inflation, Or said another way, if they kept pace with inflation, college would cost 25% of what it is today. How do you change that? How do you improve efficiency? Well, you got to create more output with less input. I don’t see how we do that within the bounds of the existing classroom. We might be able to do that if we intelligently adopt technology in ways that allow us to educate more students with fewer resources than what we’re using today. The problem is, that’s really scary for a lot of my colleagues, and myself, as I’m very transparent in the book that this poses a threat to me too. And I think this brings us to the point where we’ve got to figure out what’s my core value here. One of the quotes I have in the book is a colleague who, a bit tongue in cheek, and I’m going to use it with permission but without attribution, said, “You know what, Mike, the professor has to have an incentive to adopt the technology. I’m a tenured old fart, I can ride out this technological change until I retire. Technological adoption will occur one funeral at a time.” And again, I know he was being cheeky, but I think in the back of our minds, a lot of us are like, “I’m just going to try to hang on to the existing thing for as long as I can.” I’m not sure we’re going to be proud of that decision 15 years from now. Congratulations, you’ve presided over an institution that you know is leaving deserving kids behind solely because they grew up in the wrong zip code. You’ve benefited yourself, are you proud of the outcome? I don’t think we’re gonna be.

Rebecca: It’s really hard to make those choices, of course, when you’re feeling very comfortable, and those choices may make you very uncomfortable. But I think that’s just in terms of the personal impact versus that bigger social impact that I think many of us are really committed to, but then our actions don’t always follow that commitment.

Michael: Yeah. And again, I try to be transparent as possible in the book that I’m as subject to this as anyone, friends. It wasn’t until I started staring at this, that I really had this “Oh, crap” moment of “I’m doing things, we’re doing things that are contrary to our values. Maybe we need to start questioning the structure and thinking more about those values.”

Rebecca: What role do faculty have in starting to initiate these changes?

Michael: It’s a great question, I think we need to start questioning the assumptions. Here’s a good starting point for that. I was talking to another colleague about this. And what she said, and this is going to be close to a direct quote, was, she said, “We train our students to identify and dismantle unjust social structures in every aspect of society, except our own.” I would love for us to start thinking about our own unjust social structure, and how can we change it in a way that creates more justice for students who deserve it. And the only way I’ve been able to come up with ideas about how to do that is by changing the structure. I just don’t see how we do it from within the existing structure where I teach 35 students for 80 minutes at a time twice a week, blah, blah, blah. The cool thing is, I actually think we have a decent number of examples of success, success, not only in creating more equity, but also in creating a viable and sustainable system. If you look at what Paul LeBlanc is doing in Southern New Hampshire University, if you look at what Mike Crow is doing at Arizona State University, if you look at what Zvi Gali did at Georgia Tech with his online master’s in computer science program, I think they’ve all been very successful at increasing equity, and also very successful at creating a sustainable business model.

John: So what should other institutions consider doing to transform their institutions into one which is more sustainable?

Michael: This is where we get into strategy. And, again, I teach technological change and economics and strategy. I honestly think, if you’re looking at this as we want to create mass market four-year degrees, I think Southern New Hampshire and Arizona State have a big lead in the market, and it’s going to be hard to catch up to. But if you’re looking at niches, if you’re looking at specific degree programs, I still think there’s a whole bunch of opportunity out there to say: “Can I create a program that appeals to a specific market engineering, for example, that is delivered online, but it’s delivered online in a very high quality way.” And I’m going to even pause there for a second and say, delivered online is probably too strong. So in my technological change course, I bring in the head of data analytics at the University of Pittsburgh Medical Center to talk to my students about how data is changing health care. And right after the pandemic, he came in and said, “You know what, Mike, we’ve looked at our data and what we’ve discovered is that for most doctor-patient interactions, telehealth yields equivalent health outcomes as you coming into the office. There’s some things you’ve got to come into the office for, but most things, telehealth works just fine.” What’s the parallel? I think there are a lot of things we do in higher education that can be delivered perfectly well remotely. Some things need to be done in person, and I would love for us as educators to think really hard about what are the things that have to be done in person, and what are the things that can be done perfectly well online, maybe even better online? So it’s not 100% in either direction. And then I’ll have people say, well, there’s some things trying to get it more in the in person side. And the example I think of there is I talked to Ara Austin, who’s the professor at Arizona State, who teaches organic chemistry remotely. You say, “How the heck do you teach organic chemistry online? Are you mailing hydrochloric acid to students’ homes, and hoping they have a fume hood somewhere available?” And the answer is, what they did is they looked at their curriculum, and they discovered that 13 weeks of the 14-week semester can work perfectly well online. For the labs, they actually bring students on campus, and they do a one-week intensive organic chemistry lab experience, you do two labs a day for six days. And what they’ve discovered in serving the students is that the online students’ knowledge of organic chemistry is equivalent to the residential students, but they walk out with a higher identity as scientists. There’s something about doing two O-chem labs a day for six days that you walk out and say, “I’m a scientist, I can do this,” that you wouldn’t get if you did those same labs, one lab a week, over the course of a 12-week semester. I think there are a bunch of things out there where I’d love for us to get excited about saying how can we redesign the classroom in a way that might even create better educational outcomes, while also including a whole bunch of students who otherwise would have been excluded.

John: One of the challenges is that student bodies have become increasingly diverse, but instruction is often aimed at the student in the middle of the distribution. One of the things Carnegie Mellon is known for is the Open Learning Initiative and the development of adaptive learning platforms. Is that something that colleges might be able to leverage to increase the scale of classes to lower the cost per student?

Michael: Yes. And heck, yes. So let me go back to my roots studying the entertainment industry. One of the really interesting things about the rise of streaming platforms is… we’ve actually got a paper coming out showing that we’ve seen an increased diversity in casts on streaming platforms, because you’re not tied to the mass market delivery. When I teach a class, and I talk about this in the book, of 30 students, I’m pretty sure 10% of them are bored, and 10% of them are completely lost. The problem is that, in that delivery modality, I have no time for the 10%. I’m trying to keep the middle 80% of the class happy. Wouldn’t it be cool if I could identify the 10% of students who are bored and say, “Alright, let’s go on to the next topic,” and identify the 10% of the students who are lost and say, “Alright, let’s spend a little bit more time on this topic so that you get it before we go on.” We can’t do that in the traditional delivery model. But we can online. There are a lot of ways to say I’m going to personalize this in the same way that streaming platforms say I’m going to personalize what’s being shown to your preferences and needs. I think we can personalize the way the education is delivered to the preferences and needs of the individual student.

John: And I could see a system where that results in recommendations for students for their next courses. You’ve done well in this, you may want to consider these alternatives for next semester.

Michael: Yeah, I talked to a colleague in the business school who got his degree in electrical engineering. And as I was talking about this, he said, “You know what, I just saw a YouTube video and for the first time understood what a Fourier transform was, and what it was used for.” This is this key concept in electrical engineering and signals. 20 years later, he saw a video, he’s like, “Oh, that’s what it’s for. I can do it mechanically, but I never really understood.” Wouldn’t it be cool if we could have a set of different ways of explaining a concept and match the different ways of explaining to the students to what we think the student is likely to resonate with? The other way of thinking about this is students’ preferences for faculty. Here’s what I mean by that. When my daughter was president of the STEMinest club at her high school, so take feminism and combine it with STEM and you have STEMinism. And when she was going into her senior year, my STEMinest daughter wanted to take AP physics. And the high school said, you can’t take AP physics because you don’t have AP calculus, you can’t take AP Calculus, because you don’t have precalculus. And you can’t take precalculus, because we’re not offering it this summer, I’m sorry. And that didn’t really work for me and my wife. And because of the research I was doing, I knew that there’s a site called Outlier.org that delivers a whole bunch of classes, including calculus. And by the way, if you pass the class, you get credit at the University of Pittsburgh. So my going back position was, “Hey, if my daughter passes this class that gives her credit at the University of Pittsburgh, are you really telling me that’s not good enough for high school calculus?” Anyway, we won that argument. What was really interesting about the way Outlier designed her class is they had three different teachers teaching the same modules in their own voice. So Tim Chartier, a white guy like me, calculus professor at Davidson; John Urschel, African American scholar, who just finished his PhD in math at MIT, and by the way, before he started his PhD, was the starting guard for the Baltimore Ravens. So munch on that for a second; and then Hannah Fry, University College London. And they each teach the same topics in their own voice. And you, as the student, can choose which of these professors do I take? Guess which Professor my STEMinest daughter gravitated towards. She immediately gravitates towards Hannah Fry. And I mentioned this to a colleague, and what my colleague said, “Oh, Mike, there’s a bunch of research that shows that, in general, men do better than women in quant- related classes, and that difference goes away when the class is taught by a woman, and by the way, the same thing is true for underrepresented minorities. In general, lower performance, and that difference goes away when the class is taught by someone who looks like them.” Wouldn’t it be cool if we can allow students to self select into the teaching style or the background of the professor that’s most going to resonate with them? It’s really hard to do that in the traditional environment, but we can online.

Rebecca: Yeah, I think this personalization is something that I’ve also been thinking a lot about, and it’s super possible. We have the technology to do it, just our institutions aren’t keeping up. And as a designer, I am always thinking about audience. And when I’m working with my students, we’re constantly talking about how it’s impossible to design for everybody. Like there’s no such audience as everybody, [LAUGHTER] there are specific people who are in your audience, and the more specific you can get, the better you can design the experience. And that’s exactly what you’re describing.

Michael: Exactly. Yeah. And it’s gonna be really hard if we take the existing 30 person twice a week delivery model as a given. But if you relax that assumption, there’s a whole bunch of really cool things you can do.

John: Changing the focus a little bit, you talk about how faculty perceive the role that we play in preparing students for their future careers in education. But you also present some evidence on how employers and the public and students perceive the way in which we prepare students for their futures. Could you talk a little bit about that?

Michael: Yeah, there’s this huge disconnect, respectfully to my colleagues, between how we perceive ourselves and how the outside world perceives us. In 2020, I wrote a piece in The Atlantic, basically saying that higher education in 2020 looks a lot like the entertainment industry did in 2015. We are fat and happy and completely unaware that technology is about to change how we deliver our product, for lack of a better word. What was really interesting is the feedback on that piece from outside the academy was overwhelmingly positive, and frequently expressed a great deal of anger and frustration towards the institution of higher education. The feedback from within the academy was overwhelmingly negative and frequently expressed a great deal of anger and frustration towards anyone who would question the institution of higher education. Like there’s this enormous disconnect. It almost reminds me of early in the demise of the cable subscriptions. So there’s a guy named Chase Carey, he was the COO of 21st Century Fox, and in 2013, he was asked at an investor’s conference, “Are you at all worried about people canceling their cable subscriptions?” And he said, “Not at all. People will give up food and a roof over their head before they give up cable television.” And my guess is he said that because he had surveys showing that people will get behind on their mortgage and behind on the credit card payment, beforer they get behind on their cable bill. But it wasn’t because they loved cable, it was because they had no other alternatives. I think we, in higher education, look at “people keep showing up. People keep showing up and paying my high prices, they must love my product.” I think there’s another way to interpret that data and it is they have no other options than to paying us a whole bunch of money. The smart thing for us to do from the perspective of the business model is to eliminate any other options for students. But I think the right thing for us to do from the perspective of society and our own moral standards, is to want to create other ways for students to get the knowledge they need so they can just demonstrate that knowledge in the workforce. That’s the change that I think needs to happen in how we look at these things.

John: That’s a message I think that we all need to hear a bit more often, because it’s really easy to become complacent with where you are and what you’re doing and just assuming that it’s serving everyone’s needs, and we don’t want to be in the position of the cable companies or the traditional print newspapers and so forth in response to a changing environment that may make us obsolete unless we adapt.

Michael: That’s the hard part. What’s interesting to me is how hard it is for market leaders to identify and respond to change. And when I teach this in class, if you teach it really well, disruption is an incredibly depressing topic because the last slide in every good disruption story is “and the incumbent died.” Blockbuster, dead; BlackBerry, dead; Britannica, dead. And if you teach it really well, there’s some kid in the back of the class who’s gonna go: “Can you get any example of an industry that responded well to technological change?” And for a long time, I sort of mumbled that answer, but now I’m starting to say “the entertainment industry.” If you look at what Bob Iger did at Disney, he blew up their organizational structure to go after this new opportunity. I’ve got this really interesting quote of Bob Iger saying, “When I launched streaming and Disney plus, I looked at my organizational structure, and I realized that it didn’t make sense anymore.” And if you sort of dig down, every entertainment company has a president of home entertainment, president of television, president of theatrical, president of international and all those peoples’ jobs is to protect the old way of doing business. Bob Iger blew that up and created an organizational structure that looked a lot like Netflix. What’s the parallel here? I think we need to think really hard about our incentives and our organizational structure, if you will. I was talking to Zvi Galil at Georgia Tech, and what he said is, “I got the faculty to adopt this online teaching method by changing their incentives and making it in their financial interests to teach online.” I think, leaders at the top, if we want to adopt this, you’re gonna have to think really hard about what’s my existing incentives, and how can I change those incentives in a way that encourages faculty to adopt this new innovation?

Rebecca: In your book, you have an interesting story about a president who gave a talk about why it cost $60,000 to attend my university. Can you share that story with us?

Michael: Love to. I’ve given this talk at a bunch of different universities, and when you give this talk, you have these interesting side conversations with people and one of those side conversations was someone who had heard their President give a talk to a local community group titled “Why does it cost $60,000 to attend university X?” and the President said, three reasons. Number one, technology doesn’t lower my cost, it actually increases it because I still have to maintain all the big buildings and now I have to invest in new technological systems. Number two reason that it cost $60,000 to attend my university is because I got to keep up with the Joneses. If all of my competitors are building big, beautiful dorms and big, beautiful buildings, I’ve got to build those same buildings if I want to remain competitive, and the number three reason because I f’ing can, although he didn’t use f’ing, he used the actual word… because I f’ing can. And he went on to say, “Every year I raise my prices, and every year I get the same number of students, if not more.” And while he didn’t use those words, what he’s saying is, I’m not on the elastic point in the demand curve, my market is inelastic to price increases, why shouldn’t I increase my prices? And so I came home and shared this story with my wife, which I found pretty compelling. And my wife who has an MBA and a Master’s of Public Policy, she doesn’t leave me to mansplain price elasticity to her. She listens patiently and nods. And then at the end, she says, “So, let me see if I’ve got this straight.” And after 30 years of marriage, what I’ve realized is, “let me see if I’ve got this straight” is shorthand for I’m about to destroy you rhetorically. “So this university is a 501-C3 nonprofit.” “Yeah.” “So that means they’ve taken tax-exempt status from the government in exchange for an agreement to act in a way that is consistent with the public good.” “Oh… yeah.” And she said, “I’m fine if they want to behave like a profit-maximizing monopolist, just give back the tax-exempt status.” I don’t mean to pick on any university presidents. They’re doing what their incentives tell them to do. I would love for us to come back and say, “What’s my mission?” If my mission is to increase my prices, because I’m not on the elastic point of the demand curve then go for it, but give back the tax-exempt status. The tax-exempt status implies that my mission ought to be bigger than that, ought to be doing what’s right for society. And I think that’s going to require a lot of change.

Rebecca: Thank you just underscored our call to action for this episode.[LAUGHTER]

Michael: I hope so.

Rebecca: Perhaps this is a great moment then to switch to our last question, which is: “What’s next?”

Michael: What’s next?, I think what’s next Inside colleges, is for us to get more excited about our mission, and then changing our model to best support that mission. And like I said, I think that’s going to require a lot more technological adoption than what we’re seeing today. Honestly, I think what’s next outside of higher education is for employers to start to adopt more hiring practices that, frankly, de-emphasize the four-year degree in favor of emphasizing skills. “Do you have the skill? I don’t care where you got it from.” I think we’re starting to see that. And when I give this presentation, I’ve got a slide in the presentation that has a bunch of headlines from press outlets saying this or that company is de-emphasizing the four-year degree in their hiring practices. The next build of that slide is a quote from each of those articles saying, “and they’re doing it because they want a more diverse workforce. And they’ve recognized that I can’t get that diversity if I continue to rely on elite colleges.” A, I think that means employers are starting to pick up on the fact that colleges aren’t delivering the students that I want , but B, I think that ought to be a call to action for us in higher education. Because if you think about it, what it means is that the evil capitalists in the business market are further along than we are in terms of embracing diversity. Maybe now’s the time for us to try to catch up.

Rebecca: Well, thank you for such a great conversation and many things for us to be thinking about as perpetuators [LAUGHTER] of the higher ed system as it exists. So I think there’s a lot of room for us to each, individually, make small moves to start shifting things.

Michael: And I want to put a big caveat on a lot of what I’ve said here, I don’t know anybody in higher education who would say “I’m excited about excluding people,” I genuinely think we’re all on the same page. I just think we’ve gotten into this world where we assume that what we’ve always done in the past is the right thing to continue to do. And I’d like for us to question those assumptions.

John: Well, thank you. You’ve made a lot of really good arguments about the need for change. And I’m hoping that we all start thinking about ways in which we can adapt to create a more inclusive educational environment, and perhaps slow down that cost increase or find alternative routes to training our students to become productive members of society.

Michael: Thanks, John and Rebecca, it was wonderful being here with you and I really appreciate you having me on the show.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

334. Journey Toward UDL

Most faculty begin their teaching careers with little preparation in effective teaching practices. In this episode, Jeanne Anderson joins us to share her journey toward inclusive teaching practices and universal design for learning. Jeanne is a faculty development coordinator at Waubonsee Community College, and an adjunct faculty member in the English departments at Elgin and Waubonsee Community Colleges, and the College of DuPage. She teaches a mix of online, face-to-face, and hybrid writing courses.

Show Notes

  • Tea Tree
  • ACUE
  • 4 Connections Curriculum
  • Transparency in Learning and Teaching (TILTHigherEd)
  • Behling, K. T., & Tobin, T. J. (2018). Reach everyone, teach everyone: Universal design for learning in higher education. West Virginia University Press.
  • Tobin, Tom (2020). Pedagogies of Care: UDL. Tea for Teaching podcast. Episode 138. June 3.
  • Angelo, T. A., & Cross, K. P. (2012). Classroom assessment techniques. Jossey Bass Wiley.
  • Darby, F., & Lang, J. M. (2019). Small teaching online: Applying learning science in online classes. John Wiley & Sons.

Transcript

John: Most faculty begin their teaching careers with little preparation in effective teaching practices. In this episode, one faculty member shares her journey toward inclusive teaching practices and universal design for learning.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Jeanne Anderson. Jeanne is a faculty development coordinator at Waubonsee Community College, and an adjunct faculty member in the English departments at Elgin and Waubonsee Community Colleges, and the College of DuPage. She teaches a mix of online, face-to-face, and hybrid writing courses. Welcome, Jeanne.

Jeanne: Thank you, John.

Rebecca: Today’s teas are:… Jeanne, are you drinking tea today?

Jeanne: I am. I was out and about today, and I stopped at the Tea Tree in downtown Batavia and told them I needed something tasty that would give me some endurance, because I’m a little tired today. I just got over COVID. And so they actually made me a cup of endurance tea.

Rebecca: Oh, look at that.

John: Excellent.

Rebecca: Who knew? [LAUGHTER]

Jeanne: It’s a mix of herbs that have been traditionally used for increasing stamina.

Rebecca: Well, I hope it works.

John: I do too.

John: And I have English breakfast tea today.

Rebecca: Oh, it must be a theme. I have Scottish afternoon tea. We’re all looking for a little energy. [LAUGHTER]

John: …which is a little more appropriate because we are recording in the afternoon, at least here on the East Coast. We met at the POD conference back in November and we sat at the same table at one of the sessions. And we talked a little bit about your practices. And we’ve invited you here to talk about how you’ve integrated inclusive teaching practices, including UDL into your writing classes. Could you tell us a little bit first about what prompted you to adopt a UDL approach in your classes?

Jeanne: Well, John, I have four kids between the ages of 14 and 21. And three of them are neurodiverse. And my 21-year old has autism. My 15 year old has dyslexia and my youngest has ADHD. I started teaching in 2000. I became a mom in 2003. And autism was a word that was introduced in my life in 2005, when my son was 21 months old. So throughout the time that I was starting to teach, and also then throughout the time that I was raising my son, there was a constant theme of having to meet him where he was at, because most normal kids, babies, you would put them in a stroller and go to the mall, and they’d sleep, where my son would cry and scream. But if I brought him home, and he went in his little swing, he was quiet and he was content and he was happy. And so there were just a lot of things that I had to give up at that time to be able to meet his needs. So I had an interview for an adjunct position while I was still in graduate school, at a college in Chicago on a Tuesday afternoon, right after Labor Day. And by mid-afternoon, they were walking me to HR, and I was being told that I would have a class very soon. And then the man I interviewed with, Mr. Haynes, he turned out to be one of my mentors, he came back and he said, “Oh, can you sub tonight? You get paid $150, all you have to do is pass out the syllabus and turn on a video.” And I was like, I could watch a movie for $150.” So I go down and I do my subbing thing. And he knocks on the door, and he hands me a set of books. And he says, “Okay, your class is Monday, Wednesday (it’s Tuesday night I won’t be home till 10). your class is monday, wednesday at eight o’clock in the morning, and you’re teaching Comm 101. And I’m thinking “this isn’t even my discipline.” And so I kind of got thrust in this classroom, not knowing how to teach, as many of us are, and we rely on the good or bad practices of our previous instructors in college. Really, one of the first principles that I talk about, one of the first things that I have to be intentional about, is meeting students where they’re at. And I do that because, at the time, I didn’t know what else to do with them. And so I would just gauge who they were and what their needs were and I would try to meet those needs. And so that’s really the first seven years of my teaching career, I kind of relied on that principle of just doing what my other teachers used to do, and meeting my students where they were at.

Rebecca: Definitely a good way to get involved in inclusive teaching and a good framework to dig into a lot of models that are out there.

Jeanne: Definitely, and this college, they didn’t have any remediation. And they really took a lot of students from Chicago Public Schools who truly needed the remediation. And so as a faculty member in these classes, I really had to figure out what their needs were. I couldn’t fix them, but I could give them the best college experience that I could in the courses that I was teaching. And so that’s really what I sought to do. It was also a very diverse group of students. Most of my students were either Hispanic or black. And so, again, another reason to just meet your students where you’re at, get to know them and make them feel comfortable. They’re in a setting where they feel like they don’t belong. And so years before I knew about imposter syndrome, I’m in a classroom having a severe case of impostor syndrome with a group of students who also have impostor syndrome, and that’s really been the bedrock of how I started working with students in the classroom, is making them feel comfortable. Some of the professional development that I’ve done has really informed my teaching practices in a new way over the last few years. The first third of my career was me just kind of figuring out how to teach and also having a child with autism, and using some of the skills that I picked up by raising him, applying those things to the classroom. Whether it’s slowing down my speech and being more intentional and direct in the things I say, that was one thing that I did with him. The second third of my career, we adopted two children, and so I kind of took a backseat. I was still teaching an insane amount of classes, but I wasn’t really making much movement in professional development. And that’s where I was working on getting diagnoses for dyslexia and ADHD, and trying to figure out in their education, like how does trauma inform their education? How are learning disabilities informing their education? How does the fact that they grew up in a Spanish speaking home for the first four to six years impact their education? These are all things that I can think about when I’m talking to my students, because as a writing instructor, especially since my first assignment in English 101 is a literacy narrative, they’re very open about if they grew up in the Spanish speaking home, or if they had a learning disability and they hated school, and the fact that they know that I have this background kind of fosters that engagement and connection. So the last five years, I’ve really focused more on professional development. And I took the ACUE courses. And then I became a Faculty Development Coordinator, and at College to DuPage, they offered a paid course for adjuncts. The curriculum was 4 Connections, that’s what the course was called. 4 Connections comes out of Odessa College in Texas. And the 4 connections are checking in with students regularly, practicing praxis (which means maintaining rigor, but also having flexibility), one-on-one check-ins, and learning students’ names. And so as far as inclusive teaching practices are concerned, again, these are all things that when I started teaching, they were almost frowned upon. You don’t want to engage with your students too much. You’re there to lecture, they’re there to learn, and there’s no late assignments, and if you plagiarize, then you’re out of here. And these were all habits of faculty back in the early 2000s that I grew up under, but that didn’t work for me. And so I looked at these 4 connections, and all of a sudden, it was very validating, because it was like, “Well, I’ve kind of been doing this all along, checking in regularly, that’s something that I do with students, the one-on-one meetings, that’s the one that always kind of enrages faculty, especially adjuncts because of how thinly we’re spread. But if you can get past the I don’t have to meet with every student one on one, I started that process by saying, Okay, we’re post pandemic, I’m comfortable with Zoom… I went from “Why are you taking an online class, if you want to talk to me, you should take an in-person class,” that was kind of the mentality of the early 2000s and mid 2010s. I went from that to, “Hey, it sounds like you could really use a zoom call. Let’s get together. Let’s have a one on one, let’s talk” and really just students getting to know me and me getting to know them a little bit really helped get them on track. They needed that engagement to get on track. The practicing praxis, I used to be told in my early years, “Oh, you’re too flexible. If it’s past the deadline, you shouldn’t take it, it’s a zero.” And in the culture that I was working in, nobody was turning things in on time. There were so many obstacles to the students I had in the beginning. Being a writing instructor, students definitely walk into your classroom not wanting to be there, and believing that you are judging them from the get go. And you kind of are. And so it’s always been my intention to make students feel comfortable so that I can get the best writing from them as well.

Rebecca: What are some of the strategies that you use to make students feel comfortable?

Jeanne: I was thinking about my teaching style, and how I would talk about it. I came up with four principles that I really follow: being intentional about meeting students where they’re at, so getting to know your students and meeting them where they’re at while also maintaining rigor and meeting those learning outcomes on the syllabus, because those are two very important components of getting your students through your college courses. I’m also very intentional about engagement. So when I start a class, whether it’s online or face to face, I want my students to know that they’re making friends in this class, and that they and their peers and myself were all part of a learning community, and I’m learning from them. I don’t necessarily call myself an expert. I have so much to learn. And a lot of things that I learned, I learned from my students. I give them an assignment, and they give it back to me, and then I learn about what are the good aspects of that assignment, and what parts of that assignment really need to go. My students teach me that. I can’t learn that on my own. And so having that rapport and that engagement in the classroom is very important to me, especially since the majority of the courses I teach are online. Being transparent is also very important. And I was introduced to the TILT framework (Transparency in Learning and Teaching). And as an English instructor, and as an online instructor, I have to give very clear guidelines to students, because I’m not in the classroom with them. So they have to be able to read the guidelines and follow them. And so I’ve always been pretty good at writing those assignments and getting that across. I’ve tweaked it over the years, being more intentional about letting them know the reason why we’re doing this assignment. I’ve never been a teacher to have like a bunch of readings just because we should have a bunch of readings. Whatever unit we’re in in the English 101 class, I want the exercises that we do in these classes to help them in their final destination of that research essay that they’re putting together for the course. And then the fourth principle has to do with the UDL implementation. And that’s really having that plus-one mindset. Adopting a plus-one mindset is really important, because there’s always one thing that I can do, maybe I’m just doing one thing this week, maybe I’m doing one thing a day, maybe I’m doing one thing a semester, but there’s only one way to improve my curriculum. There’s always one way to improve meeting students’ needs.

Rebecca: So for folks that are interested in that plus one mindset, it’s introduced in Reach Everyone, Teach Everyone by Tom Tobin and Kirsten Behling.

John: And we do have a podcast with Tom that we’ll share a link to in the show notes. Maybe you could talk a little bit about how you’ve implemented some of those UDL principles in your class, as you’ve continually done the plus one thing.

Jeanne: Well, they talk about multiple means of representation, multiple means of expression and multiple means of engagement. So I’m always looking at my curriculum and thinking, how can I better represent, how can my students better express what they know? And how can we improve engagement? For multiple means of representation, I started revising my syllabus, first of all. I tried to use more inclusive language, a little more colloquial, a little more warm, not having these really strict rules, but kindly sharing what was expected of students in a tone that reduced that imposter syndrome, telling students directly in my syllabus “you belong” is important. Another thing that I did, I learned about how to create like a visual graphics syllabus. For example, for my English 101 class, we have four papers that students write. And so on one page, I outline the entire course with what the whole course will look like and some of the things that they’ll be learning. Under each paper, I would talk about specific skills that they were going to pick up under that paper, during that unit. So they could see the entire class on one page. It will list the papers and what percentage they’re worth. And it’ll list a little description of what is involved. Our final paper in the English 101 class is a career analysis project. And so day one, I want them to know, “Hey, you’re going to be writing a paper about the career you’re interested in.” So let’s start thinking about that. And so a lot of the scaffolding that I put in place from paper to paper helps students follow the general outline of the course. I also use a skeletal outline. When I teach a face to face course, I actually set it up on whatever learning management system I’m using in the class. I set it up the same way I would an online class. I do that because I don’t want to forget anything. But at the beginning of class, I can go over the page and say, “Okay, these are all the things that we’re going to get through today.” And students know, and they’re not getting restless in their seats, especially because I mostly teach night classes. And you can just imagine By seven o’clock how much they want it to be over. And thankfully, I don’t have a ton of content that I have to get through. And so it’s like a half discussion/lecture, half of the class is us working together. And the other half is lab time. And as part of like an inclusive teaching practice, during lab time I meet with students regularly, one on one. And again, I’m getting to know them, I’m finding out “How was work today?” But I’m also finding out “Where are you at with your writing practice today?” And if you put something in place for one student, every student can benefit from that. So like if I have a blind student who needs her readings to be audio, the mother who is driving her kid to soccer practice can also benefit from having an audio version of the text. I’ve really embraced that idea of, when I put something in a course, trying to give them a graphic, trying to give them the text, and then trying to give them an audio or audio-visual component. I use Zoom a lot to create my videos. And so we have the closed captioning, they have the PowerPoint, they have the option of reading the transcript, maybe all those things can be overwhelming, but then turn off the closed captions and just have the PowerPoint and the talking. A lot of times I don’t even have the PowerPoint, I just have the screen for the learning management system, which is not always smart, because I use three different learning management systems, so that I have to keep re-recording those videos.

Rebecca: It sounds like those alternative formats are really helpful for students in giving options to explore the content and giving variety. And it sounds like you’re guiding them through picking and choosing which format works best for them.

Jeanne: Absolutely. And in 2010, when I got my big start in online teaching, I had completed a master’s certificate in online learning through Illinois Online Network. And actually, that was the first time I had ever heard about things like summative and formative assessments. So I was using classroom assessment techniques or CATs to check in with students. So those were things that I was learning in this class that I didn’t know about, then fast forward to last semester, and now I want to learn more about universal design for learning. So I started a digital accessibility for educators certificate. And we had a course for the foundations, we had a course where we just learned the basics of manipulating documents and making them accessible. I did another course that did the same for videos, and then the full eight-week UDL course, but the videos was interesting in that they actually recommended that your videos only be two to three minutes long, which if you’re used to teaching an hour and a half class, how do you get a two-minute video to educate your students. And I think part of that is students are used to watching shorter videos. And so if you have a 20-minute lecture, chunking it into four different videos can be very useful, because even when they have to go back, they know that that information that they want to review comes from video two, or video three, and it breaks things up for them. And you can set them up where one flows into the next

Rebecca: You were just summarizing the different ways that you were implementing multiple means of representation. You’ve talked a little bit about multiple forms in your syllabus, you talked about skeletal outlines, and then you were just talking about multiple formats for lectures. So one of the other UDL principles is thinking about multiple means of expression or ways that students can demonstrate their learning. Can you share some of the ways that you’ve implemented that into your teaching?

Jeanne: Sure, well, again, because I teach primarily online, I rely very heavily on the discussion boards. And so I do definitely start out with the icebreakers. And it’s not a best practice to answer every student on the discussion board, but for the icebreaker I do, because I want them to know that I heard them and that I have a response for them. And so I really tried to be very intentional. And then as the discussion boards increase throughout the semester, I back off and let my students engage with each other. But what I love about the discussion boards is it democratizes the classroom, because if a student is put on the spot right there in the classroom, they can’t always process the information quickly enough. They might be shy, they might feel like they just can’t come up with the answer right then and there. But when you’re on a discussion board, a student has the opportunity to read the question and thoughtfully respond in their own timing. And that really matches the work that I do. I’m definitely better at creating courses in writing and using instructional design techniques to lay out my classes and have everything set up, do all the writing of assignments, I’m much better at the organization than I am at getting up in front of students and lecturing. That’s just what I’m better at. And so I can really understand the idea of having a new concept introduced to me, and then having the opportunity to really think about it, maybe do a little research and pull my thoughts together before I respond. And so I think having those discussion boards, sometimes I even integrate them in my face-to-face classes just to give students other opportunities to engage. I have a literacy narrative assignment, where I allow students to either write the essay, or use another modality. So like, every once in a while, I’ll have a student who will want to make a video, I don’t have all the techniques of what video software you should use. Sometimes having all that information can be daunting. In today’s age, you know, my son, he’s 21, so he’s a junior in life and he’s working in the trades. So he’s not in college. But he started using a Chromebook in sixth grade. So we have students now who have capabilities in video production that I don’t have, just because they’ve been doing it in their elementary, middle school, and high school classes. So I also have an option for them to create a comic. Because we have an example in our textbook where somebody wrote a literacy narrative,as a graphic comic. Every once in a while, I get the drawers who want to have their literacy narrative that way. And so again, there’s just multiple ways. Writing class, you can’t always have a video, students have to write. But I can sometimes give options, the literacy narrative is a great place to give students the opportunity to showcase their story using another modality. I provide examples whenever possible. I ask my students “Can I use this?” and I get more and more questions from students about, “Can I have an example?” And sometimes I don’t want to give them one, I just want them to respond. It’s a low-stakes assignment, and I want them to think. I don’t want them to see somebody else’s response. I just want them to tell me what they know. But especially for larger essays, I want to make sure that they have those examples. We read a lot of essays from published authors, but having examples from their peers, and especially examples from peers that had me as their instructor, can be very helpful to students being able to then turn around and express their thoughts in writing. And this is also where that TILT model comes in, because I want to tell them why they’re doing the assignment, the literacy narrative, the purpose is for me to get to know you as a student, as a reader, as a writer. It’s an opportunity for you to tell me your story, and what the actual prompt is, what the skills they need, there’s always a rubric for them to follow to guide them. I give them an idea of what I expect in the final product. And sometimes I’ve been learning more and more that sometimes, using specifications grading, it’s either you met the objectives, or you didn’t can be very helpful in some of these writing assignments. One of my favorite writing assignments is… I got this at a conference at College DuPage, like maybe in 2016, and I adopted it, and I’ve been using it for years, but only in the face-to-face classroom. It’s students pairing up to groups of two or three, and they choose a movie and they do their own version of “At the Movies with English 101.” I don’t know if you’re old enough to remember this, Rebecca, I know John is, but Siskel and Ebert At the Movies on Sunday afternoon, I watched it with my dad every week and so I get to nerd out a little bit and do things I love and show them all these different clips of Siskel and Ebert. And then they get to pair with somebody and watch a film and write a script that they present to the class. And so what I’ve learned over the years is that it’s not even really necessary to grade this assignment, because I’m really only grading on grammar and punctuation because they work so hard on it because they’re presenting it to their peers, and they’re working with another classmate that it’s a pure learning experience. And last semester, I had a student who was talking to her partner, and she said, “This is so fun. This is like doing a podcast.” And I thought, oh my goodness, I can bridge. I tell them to write a script and they look at me like a deer in headlights. But if I say they’re gonna do a podcast about their favorite movie, now I’ve reframed the assignment in terms that they understand. So that’s what I’m going to do next time. And like I said, if you’ve done the assignment, you get full credit because I’ve never had a student not do the assignment. I do have a rubric for the person who takes advantage, just in case they’re out there. And really the only way to lose points is if you don’t present your individual reflection on the entire process. So I feel like that is just one of those ways to meet students where they’re at by giving them the freedom to work with somebody else and see what kind of writing they can produce without too many parameters. And they’re almost always successful.

John: You had mentioned something about a career analysis project. Could you tell us a little bit about that?

Jeanne: Sure. That came out last spring, I had a late start class. And they were supposed to be writing an editorial and I was barely getting film analysis and literacy narrative essays from them. They were really struggling as a class. And I was trying to figure out a way to motivate them. And I’m thinking, if I have them write an editorial, that’s not going to work for this group. And so I scrambled, and I thought, well, as a freshman in college, most of the students who take English 101, this is their first time in college, and thinking about the TILT model, what can they write that gives them purpose? And so I came up with “Well, every student’s going to want to get out of college with a career, and we can still meet the learning objectives in the class.” So the final product is the actual essay, and that is totally graded with a rubric and they have to meet all the learning objectives, work cited page, introduction, thesis statement, all those components of a basic essay, source integration, synthesis. We’re in the early stages of getting them ready for that English 102 class. And so they can write an essay about their career meeting all those objectives in the same way that they could write an editorial meeting those same objectives. And so I always start a paper like that with an annotated bibliography. And so I got the librarians to help me find websites where students could research their careers. And so the librarians put together a page for me that students can refer to, and I’ve since created short videos, where I explain the different databases to them. Right now, I think I have like a 12-minute video that I did. So the next step is, instead of talking about all the databases in one video, talk about different individual databases in two to three minutes, breaking that down and meeting them even better than I was with a 12-minute video. So they write their annotated bibliography, and that gives them an opportunity to work on MLA citations, work on summarizing, and thinking about how they’re going to use that material for the final essay. That’s part one. Part two is using ChatGPT to have a conversation, I call it a ChatGPT interview. And so now that students have done the research on their own, now they’re taking what they know and I give them a series of prompts. And I’m giving them the experience of using ChatGPT to inform their writing and the research. And so I’m not necessarily concerned about the interview. I’ve very recently learned that instead of them describing the process, they can send me a link to the actual interview. So it’s evolved from describing the process to: write an introduction, give me your link, and then write a reflection on what helped and what didn’t help and how you think this is a valuable tool in education, how you think that ChatGPT could derail you in your education. And so I know a lot of English faculty are very wary of AI in the classroom with good reason, because I’ve gotten a few of those papers. And I’ve probably gotten more than I think, and they’ve gotten under my nose. But it’s like the internet was 20 years ago. It’s a tool that’s not going anywhere. And so it is our responsibility as educators to introduce students to these tools and talk about the ethics of them. And so this is just an opportunity to kind of slip that in. And the feedback I’ve gotten from most students is “Oh, yeah, I got really good information. Some of it wasn’t accurate based on my research. I could tell from the tone of what I was reading that it was robotic, and I definitely wouldn’t want my writing to sound that way. But it was nice to put some ideas in and get some feedback from those ideas. So part one is the annotated bibliography. Part two is the ChatGPT interview. Part three is that final essay, and this semester, I’ve added a part four, because I wasn’t feeling like this assignment was robust enough. And I’ve also been in conversations about UDL, giving students multiple ways to express what they know. And so I actually went into ChatGPT and I put part of my assignment in it. And I asked him to write me guidelines for doing a media presentation. And so now they’re going to have to take what they’ve learned in their essay, or what they’ve written in their essay. And they have to take it a step further and do some kind of a PowerPoint or video or some kind of visual component, so that they can, I guess, bring what they know, it’s not just an essay, but they’re sharing it with the world in some respects, or they have something that they could share with the world. And so this will give me an opportunity to talk about portfolios, ‘cause some nursing students need those kinds of things. I know I did when I was in public relations, journalism was my major. And so I know when I got out of college, I needed a portfolio. And so this is just another opportunity for them to maybe have a little bit of fun with the content. And it brings them more into the 21st century. Our students, I’m sure many of them aspire to be influencers. They love their YouTube. So this is a way for them to live out that dream a little bit.

Rebecca: Sounds like an opportunity to think about audience as well.

Jeanne: Yes, definitely.

Rebecca: How have your students responded to these opportunities in the reconfiguring of this project?

Jeanne: They have responded really well, especially with this particular project, the feedback I’ve gotten is I really appreciated the opportunity to research something I need to know about anyway. And I appreciated that you created an assignment that I can relate to, that means something to me. Not every discipline can do that. But as a writing instructor, Comp 101, Comp 102, I do have a lot of flexibility with the content. And so I focus very much on the skills that students can attain… the Siskel and Ebert, they all are looking at me, like, I’m crazy for asking them to create this podcast. But as they go through the process, I give them a lot of time in class. And as they go through the process of creating the document, at the end of the day, they have another piece of writing that they’re really proud of. A lot of them say “I had fun doing this.” And I feel like if a student is having fun doing a writing assignment, I’m really going to get to see their best efforts. I find that a lot of kids come out of high school and they come to college with this idea that I have to write what my teacher wants me to write. And I have to figure out what that is. And during the pandemic, I really got a taste of that when I was helping my son with his research paper, because he didn’t really do any writing. He started by looking for quotes. And then he explained what those quotes meant. He started with main ideas, and then he’d find quotes, and then he’d explain the quotes. And then he’d slap in a bunch of transitions and call that a paper. But there was really no like, “What do I think about this?” It was more about how do I meet all the criteria that my instructors have given me to complete this assignment. And so it’s a real privilege in English 101 to be able to kind of deprogram that thinking and give students the opportunity to really know what it’s like to write what they think,

Rebecca: Maybe to move on from just efficient solutions to things to something that’s actually valuable to them.

Jeanne: Exactly. And they’re learning skills in high school for a reason. They just lack the opportunity to really put those skills together in a lot of regular classes, I think. It’s been my experience with my kids anyway, and with my students, that they are really just re-imagining graphic organizers and presenting them to their students with all the boxes checked.

John: In your professional development role have some of the techniques that you’ve been using been widely adopted at your institutions?

Jeanne: Well, at Waubonsee, they pay for faculty to take the ACUE courses, which is a certificate in effective college instruction. And I know that there are a lot of active learning modules, there’s modules that have to do with creating a classroom environment that is conducive to learning. And there’s also a course that’s separate from the effective college instruction that is fostering a culture of belonging. And so that is a really good course to get people thinking about those around them. And at College DuPage, I do a lot of book clubs. So that’s how I got introduced to Thomas Tobin’s work, Reach Everyone, Teach Everyone and Flower Darby’s work with Small Teaching Online. And in fact, Thomas is the one who introduced me to John, at one of his sessions. So I’m a little bit of a Thomas Tobin groupie, I guess. And so I do find that any opportunity for faculty to engage with each other is really key. I know this as an online faculty member, I know this as an adjunct faculty member. I probably spent a good 10 years in a silo while I was raising my kids, and developed very slowly as an instructor, because I was really just doing my own research and learning my own things. But bringing it out into the world and engaging with other people, it really does improve your teaching strategies and your abilities at a much faster rate. And so I have really enjoyed the privilege of working in faculty development and sharing the things that I’ve learned with others and constantly also learning from others.

Rebecca: That is one of the benefits to being in faculty development, is getting the opportunity to learn new things, and from other faculty and other developers on a regular basis. I think that’s one of the reasons why John and I like to do the podcast. [LAUGHTER] And that’s why I enjoy listening to the podcasts, too. I go in these stages where I just listen and listen and listen and listen and listen, and then I burn out and I gotta stop, or I think, “Okay, I’m not listening to another podcast until I apply something from the last one I’ve listened to.” Because you know, when you’re in the car, and you’re just driving around, it can be really easy to think, “Oh, this is great, and then you forget about it.”

John: And that is a bit of an occupational hazard for being a podcaster in this area. Because there’s so many great ideas that we hear from people that it’s really tempting to try to do all of them. And that can be quite overwhelming.

Jeanne: For sure.

Rebecca: So, we do always wrap up by asking: what’s next?

Jeanne: I know and I keep thinking about that. My faculty development job is supposed to end because it’s a two-year fellowship, supposed to end in May. And so what’s next is there has been talk about keeping my fellow Adjunct Faculty Development Coordinator and I on staff. So I guess we’re waiting to figure out as we revamp that department if I will continue in faculty development. But the good news is I love teaching so much. And I love teaching online so much. And one thing that I’ve learned about the anxiety that I have with teaching in face-to-face classes is that I don’t do it enough. And if I do it more, that anxiety dissipates, because I’m in that community. So I don’t know what’s next.

John: Thank you for joining us. It’s been great talking to you again, and we look forward to hearing more about your continued evolution in terms of teaching.

Rebecca: Thank you for sharing your story.

Jeanne: Thank you so much for having me on. This was great.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

333. High Structure STEM Classes

Multiple studies have found that increasing course structure reduces equity gaps and provides benefits to all students. In this episode, Justin Shaffer joins us to discuss several ways to increase structure in STEM classes.

Justin is the Associate Dean for Undergraduate Studies and a Teaching Professor in Chemical and Biological Engineering and in Quantitative Biosciences and Engineering at the Colorado School of Mines. He has taught a variety of both small and large STEM classes in multiple modalities using evidence-based approaches and has won multiple teaching awards as a result of this work. Justin is also an active researcher with 16 peer-reviewed publications and serves as the editor for four STEM education journals. He is the author of a forthcoming book on high-structure course design coming in late 2024 or early 2025 from Macmillan.

Show Notes

Transcript

John: Multiple studies have found that increasing course structure reduces equity gaps and provides benefits to all students. In this episode, we examine several ways to increase structure in STEM classes.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca:Our guest today is Justin Shaffer. Justin is the Associate Dean for Undergraduate Studies and a Teaching Professor in Chemical and Biological Engineering and in Quantitative Biosciences and Engineering at the Colorado School of Mines. He has taught a variety of both small and large STEM classes in multiple modalities using evidence-based approaches and has won multiple teaching awards as a result of this work. Justin is also an active researcher with 16 peer-reviewed publications and serves as the editor for four STEM education journals. He is the author of a forthcoming book on high-structure course design coming in late 2024 or early 2025 from Macmillan. Welcome, Justin.

Justin: Thanks for having me. I’m really excited to talk to you today.

John: We met at the POD conference back in November, and we talked about doing this but we finally got around to actually scheduling it. So thank you for joining us.

Justin: Thank you, John. Yeah, I saw you sitting there at a table by yourself. I knew your face from LinkedIn and I built up the courage to introduce myself and I’m glad I did.

John: Today’s teas are:… Justin, are you drinking any tea?

Justin: I am drinking some tea. I got prepared. It’s from a small little coffee/tea shop in West Middlesex, Pennsylvania. I’m from the near that area in western Pennsylvania. We call it the Shenango Valley and it’s called O’Neill’s and they make lovely Western PA coffees and teas and I just have some nice black tea here. It is that time of day for me that I need some.

Rebecca: Today I have a jasmine green tea, John.

John: Very good, and today I have a Prince of Wales tea, and a peppermint tea because I didn’t have very much to drink today, and my throat was getting really dry in my econometrics class. So I wanted to be well hydrated. [LAUGHTER]

Rebecca: Lots of variety, too. So we’ve invited you here today, Justin, to talk about how you’ve implemented high-structure course design. And for listeners who might be new to the concept, can you talk a little bit about what you mean by high-structure course design?

Justin: Yeah, so just like I’ll tell you all like I tell my students, I didn’t come up with this term. I wish I did. But I’m building off the work of other giants in the field. So as far as I know, the term really came out in the mid-2000s, 5-, 6-, 7-ish range from the University of Washington in Seattle. There’s some pioneering folks, Scott Freeman and Mary Pat Wenderoth in biology and they use this term structure to think about, “Well, how do we scaffold student learning before class, during class, after class, and we’re continuously building as we go up through the three levels.” So pre-class involves some kind of content acquisition, that can be reading your textbook, reading journal articles, watching Khan Academy videos, other sources like that. And then some kind of formative assessment before class because we all know students need a little bit of a carrot there to get some of that work done sometimes, which is totally great, because you give them a lot of chances, sometimes even unlimited attempts… again, formative assessment before class, make sure everyone has the same solid foundation, then you come to class, high-structure course design, just like any good class nowadays should be really rooted in active learning. So we got a lot of activities going on: group work, problem solving, case studies, real-world connections, any kind of flavor you want to do there with your active learning as long as students are engaged. And the big thing here though, is that you’re aligned to what happens before a class. We’re building off what happens before a class, I’m not in class just repeating what happens ahead of time. Rather, I’m using the foundational material students acquire before class, we build that up with another level in class, and then we keep going. And then after class, there’s a bucket there, where students are going to be practicing those skill sets they’ve been developing through the before class and in-class buckets, applying their skills to new contexts, solving new problems, doing projects, essays, more authentic assignments, whatever you want it to be. And then there’s typically a frequent assessment piece with a high-structure course design too, whether that’s a multiple midterm model, weekly quizzes, every other weekly quizzes, things like that, in addition to some more authentic assessments, which is something I’ve tried to get more into this past year, by adding more realistic projects and course assignments in my high-structure courses.

John: Could you give us some examples of some of the authentic assessments that you use in your classes?

Justin: Yeah, thanks, John. So this is really new to me still, this past year. I know I’m behind the curve. I know this is a term has been around there for a while. I always like to think I’ve had some authenticity in my classes for a long time. I integrate news stories, I use case studies, I have this new thing I called pod cases where I take podcasts and combine them with case studies and we use those in the classroom. But I thought I could try to be a little bit more authentic, even still… getting that advice from my wife for my personal life. She always says that can be more authentic. So, maybe I can make my courses and my assessments more authentic too. One example I’m doing right now. I’m teaching introduction to biomedical engineering, and I’m having the students write the actual legit National Science Foundation Graduate Research Fellowship proposal. Those of you familiar with that, there’s a personal statement part and there’s a technical kind of research proposal part. So we’re just doing that. It’s a two-page proposal, and we’re working on this in a structured way throughout the entire semester. Last week, students had to turn in the research topic and research question. This week, they’re turning in their hypothesis, in a couple weeks they’re turning in the literature review and experimental plan. We’re gonna have two rounds of a formal peer review of the entire proposal. And then we’re going to conclude with a mock panel discussion, just like you might have in the real NSF or the real NIH where students are going to be reviewing each other’s proposals and basically pitching them to each other and seeing if they should get, quote, unquote, funded or not. I don’t have any funds for them. Maybe we’ll bring candy on the last couple of days. But that’s kind of the idea of having a real thing that students could actually use some day if they’re going to graduate school. But even if they’re not, being able to write technically and persuasively in two pages on a proposal is a really important skill that they should be working on, in my opinion.

Rebecca: Sounds like you’re going to need some chocolate coins for that day.

Justin: That’s a great idea. I will get chocolate coins. [LAUGHTER] I didn’t think of that. [LAUGHTER]

Rebecca: Can you talk a little bit about what motivated you to attempt and move in the direction of high-structured course design.

Justin: I kind of started out this way, I kind of started in the deep end, if you will. So my postdoctoral program was called spire, S-P-I-R-E, and it’s one of these bigger programs called IRACDA through the NIH. They’re postdocs where you still do research. So I was a molecular biologist, biochemist at the time. I have a weird background in chemical engineering, bioengineering, molecular biology, but at the time, I was studying muscle proteins in squid, super fun stuff. And then I also got training, though, on how to teach evidence-based college science and engineering courses. In my postdoc, through great people like Ed Neil, Brian Ray Bozic, Leslie Lauria, and then also Kelly Hogan was someone that took me under her wing at the time, she was able to, along with the rest of the SPIRE team, helped me be introduced to using evidence-based course design practices, which included with high structure. So this was around 2010-11, right when these papers are starting to come out from Scott Freeman and Mary Pat Wenderoth. I started with high structure because the evidence shows it works. And that’s as a trained scientist, as a trained engineer, we like to go with evidence ideally to guide our decisions. And it’s no different with course design and teaching as it would be with thermodynamics or reactor design or anything else. The literature on high structure is really strong, even then it’s been growing over the years, some of my own data and a lot of other papers. The main gist, though, is that by having the scaffolding before class, in class, after class, students are able to really monitor their learning, develop self-regulated learning skills, be more metacognitive. And the data in a lot of papers shows all students are doing better in the class. But it’s not just everyone, using high structure and moving up in structure will start to close or reduce achievement gaps or performance gaps between historically underperforming students and their majority counterparts. So for example, female students and male students in physics, there has traditionally been a gap there, add some more structure to the class, those gaps tend to get smaller. And I’ve been participating in that kind of research here over the last many years with undergraduate students and my research team. And we found some similar results across different STEM disciplines. It’s really the evidence guiding me in these decisions to do it. I also think it’s a lot more fun. Once I have in mind one of my very first faculty interviews, oh a long time ago, now, I had an interviewer say to me, “Well, hey, I’ve looked at all the papers on active learning, and they’re all wrong. [LAUGHTER] All the statistics are wrong. What do you have to say about that?” And I paused for a second I said, “Well, even if that’s true, it’s a heck of a lot more fun to teach actively with active learning than not, I think the high-structure design model is more of a fun way to teach. And again, you’re helping the students with those study skills and metacognitive skills that they can then take forward to their future classes.”

John: There was a recent paper that did argue that many of the studies on active learning were flawed in some way in terms of a very strict methodological approach. However, there are so many of them, and the results are so remarkably consistent. I don’t really buy that argument in terms of the questions about methodology.

Justin: You’re right, it was a big deal, I think it was either Beckie Supiano or Beth McMurtrie in the Chronicle had articles on this going around for sure. And that’s the thing though, with us, as DBER folks… I want to introduce a new term, DBER – discipline-based education researchers… which I consider myself to be in. So I’m in the discipline. I’m in chemical engineering, I’m in biology, I’m in Biomedical Engineering, and I do the education research from that lens, but also from that training background. I’ve never been formally trained in education research methods in psychology or social sciences or psychometrics. I am, totally honest, I fake it. I do what I can. I know my boundaries. I know when I need a collaborator in the true social science disciplines that helped me with my studies. And so I think that paper was getting some of that. Sometimes the folks like us that are doing this work, whether we call ourselves DBER people, or Scholarship of Teaching and Learning (SOTL) people, we might not have that true background, and therefore the rigor of the paper, the methodologies, aren’t as advanced as maybe they should be. But like you said, there’s so many studies showing benefits of this, whether it’s simple correlational studies… sometimes they get to the mixed methods, even quasi-experimental studies, but the evidence just keeps mounting and mounting and mounting. And that key paper there was the 2014 one from Scott Freeman that PNAS meta-analysis showing that hundreds of papers, hundreds of studies… again, they have their flaws, don’t get me wrong… but you start to see these themes everywhere and you think, well, there must be an effect, something’s going on.

John: And we will include a link to that paper in the show notes, if anyone would like to follow up. But the fact that there may be these flaws in some of the research methodology suggests that maybe we need to see more people doing work in this area, and that there’s a lot of areas where there’s potential growth.

Justin: Totally agree.

John: And you’ve done quite a bit of research already.

Justin: I’ve tried, as a teaching faculty member now for this is going on year 12-ish, but I’ve always made that a part of my career. Before I was at Mines, I was at University of California, Irvine, where we did have a scholarship expectation or to earn tenure as teaching faculty. The UC system is one of the few in the country where you have actually tenure-stream teaching faculty, which was really cool. So I earned that, but I only had tenure about a month because then I left and came to Colorado, which… no regrets, I love it here at Mines… but I don’t have tenure here. But there’s still some expectations for scholarship, but not as high as it was in the California system. But I continue to make that part of my career, because, again, as a scientist and engineer, I think going based on data, based on evidence to guide your decisions, moving forward is a really important thing to improve what you have, because that’s all it comes down to really whether you call it SOTL or DBER or whatever, we’re trying to improve our courses, we’re trying to improve our students’ experiences. And yeah, so I’ve tried to do what I can over the years. And now I’m at the point where I want to help other people too. So I work with faculty individually, I do workshops via my side business, and even at Mines this semester, starting next week, I have a three-part getting started in DBER series kicking off for about 25 faculty on campus. I’m going to help them get started, get their feet wet in this field, and then we’ll see where it goes. Because I think a lot of folks, like you said, John, want to do this work, they’re interested in it, they might not have the time, they might not know how to, but you kind of give them the start, hold their hand a little bit and then see where it goes, and we’ll get even more evidence to support these claims.

Rebecca: I think a lot of faculty have an inclination to have a reflective practice and continuous improvement. They’re wanting to do SOTL work, but just don’t know how to formalize that practice. And we can certainly lean into helping people move in that direction.

Justin: 100% Rebecca, even when I started, I didn’t know what I was doing. If it wasn’t for Kelly Hogan and a few other folks at Carolina and then moving on from there at UC Irvine folks like Brian Sato, Diane O’Dowd, Adrianne Williams, they really helped me understand the field more. And then you start going to conferences and going to meetings and learning more about the tricks of the trades.

Rebecca: Can you talk a little bit about ways that a high-structure synchronous course might be different from a high-structure asynchronous course?

Justin: So I think the high structure while what I described earlier, you might be thinking of okay, a Monday, Wednesday, Friday class meeting at two o’clock in a lecture hall works great. I think it works even better in online for some cases, because you think about an online situation, whether again, it’s synchronous or asynchronous, your students you’re not really seeing and there’s that human connection of having eyeball to eyeball being able to understand, “Okay, I’m here I’m motivated, I’m ready to learn.” But whether it’s the recording, that’s the worst case scenario, when it’s totally up to you, or if it’s going to be on that live Zoom remote, where you can make your screen black, and who knows what else you’re doing. I’m guilty of that in meetings for sure. But having the structure though, having that scaffolding, having the clear deliverables of what is due when and seeing that step up from pre-class, in-class, after class, whether it’s the in-class is out again, synchronous Zoom session, or the recorded video you do on your own time, there’s that scaffolding helps students stay more connected with material, they understand more of what’s going on, when it’s due, what is due, how I’m being assessed, because that’s the nice thing about with structure. And just to be clear, I’m from the STEM disciplines, but you could do this any field. The research on high structure, as far as I know, is only been published in the STEM fields. I bet it’s being done in art history, I bet it’s being done in the languages, I just don’t know about it. So if anyone listening does this kind of teaching or research, I’d love to hear from you. But you can use that scaffolding again to help students be more transparent with the course. And that’s a word that I think comes through with high structure and is really true in that online environment, especially as transparency. I always tell my students, I want to know what you know, not what you think I want you to know. And by being uber clear with the learning objectives, starting with backwards design, just a clear Canvas website for the online cases can be really helpful for that. One distinction, though, with the async online versus synchronous online, is that kind of active learning piece, because we’re not there together. So one tip I like to share with faculty is that okay, if you’re recording a video for the in class, mimic, because you’re not actually meeting in class. What I always say is “okay, well make the video, but if there’s a point where you’d want them to answer a clicker question… I’m a big clicker guy… or if you want them to do an activity, just say, Okay, everyone, pause the video here. Take a couple minutes, think about this problem, what’s the answer or work on this, whatever it might be. When you’re ready, unpause the video and keep going. That’s a way that you can add the active learning to an online asynchronous class as part of the bigger high-structure model. I find when I have to record an online video, if I have traveling for a conference because I have to miss a day of class. I’ll have a 50 minute in-person class, when I make the video recording it’s only about 20 to 25 minutes, because all the active learning I don’t do in the video recording, but I give that tip… I tell my students, hey, pause the video here, answer this quick clicker question, solve this problem, come back when you’re ready. And so that’s a way to build the active learning into the asynchronous part, which again, is part of the overall high-structure piece.

John: And also, if you want to take it a little bit beyond that, you could use one of the tools where you can embed the questions directly in the video, and have them auto graded. I use PlayPosit for that, and it’s possible in Panopto, and EdPuzzle is another alternative that many people use. PlayPosit works really well. And I’ve been using it for a couple of years.

Justin: I just learned about PlayPosit maybe three weeks ago, I was doing a workshop at CU Boulder on clickers. And I kept hearing PlayPosit, it does seem like a very powerful tool to automate that active learning in the video piece, which I really like. I just haven’t had a chance to play with it.

Rebecca: So you did just mention that you’re a clicker guy, I believe. So do you use a flipped classroom approach in all of your synchronous classes? And how are you using clickers in your classes?

Justin: Yeah, I think that’s the technical term these days, clicker guy. So, I’ll go with that. I’ve been using them for as long as I’ve been teaching in various platforms. You name the platform, I’ve used it. I’ve primarily been using iClicker, just because that was the platform we had at UC Irvine and the platform we have here at Mines as well. Yes, I love using them. I think it’s really important. And you mentioned the flipped classroom design there, too, Rebecca. So when you think of high structure, you might think, “Oh, it sounds like a flipped classroom.” And it kind of is because we’re having students do stuff ahead of time. In class, they’re very active, but there’s still that structure piece even within class. I guess maybe I haven’t seen a truly flipped class because I think flipped classes, I think in class is like purely work time, purely activities, purely worksheets, homework type assignments, whereas I do a series of clicker questions, discussions before or after numerical problem solving, if it’s more of my engineering classes that I teach in thermodynamics, or material and energy balances, more conceptual sometimes if it’s biology or anatomy and physiology, but I’m breaking up a lot of activities and any talking with clickers. And so the clickers… I love all the modern bells and whistles that they have as that’s the another technical term I use, moving beyond multiple choice. And when I do workshops for faculty with clickers, that’s what I triy to get them to do. Okay, yes, you know, you can do A B C D E, but can you do multiple answers? Can you do target questions or hotspot where you touch the screen? Can you do ranking or ordering? numerical answers? …and I’m trying to get this traction on my own campus too. So even this semester, my first five questions of the semester, which I didn’t do intentionally, but after I wrote them, I realized, oh, I should do this every class now… my first five questions in my introduction to biomedical engineering class, each one was a different question type. So we did multiple choice, we did multiple answers, we did short answer, text entry, we did numerical, and we did target or touch the screen. And when I was done, I asked my students, “Hey, who’s ever used those other question types before?” And maybe four hands went up, I said, “Cool. What class did you do them in?” and they said, “Oh, your class last semester.” I seem to be the one and only that I know of on my campus that’s trying out these other tools, although like I said, I’m trying to change that. So yeah, if you’re using any kind of device like this, any type of ed tech, for that matter, make sure you justify it, justify the cost, and you make use of those bells and whistles in class. Or if it’s out of class, courseware, whatever it might be, just make good use of the tool, and you’ll find your students that are going to be able to buy into it and use it more effectively, and hopefully learn more from it.

John: And one option that we have here is a campus license, which actually is much less costly per student. And that reduces that barrier of students having to pay for it, which has led to a pretty rapid expansion in the use of it on campus.

Rebecca: One of the things that I really like about your example of the five questions is that extra level of scaffolding, of introducing all of the question types right away, and giving everybody an opportunity to practice those question types that you’re going to be using all semester. And so I just wanted to make explicit that other layer of scaffolding that you have built in there.

Justin: Yes, teaching students how to use the tools is very important. Thanks, Rebecca, for mentioning that, because whether it’s the app now on your phone for these clicker devices, or if it was the old physical device, there’s a learning curve with them. And same thing, even if it’s computational tool, or like Desmos, or something for a calc class. Yeah, you got to be able to teach students how to use the technology properly first, before you expect them to use it well. I will say though, with the learning curve of the clickers, when I was at Irvine, the app wasn’t really there yet. So everyone had the physical iClicker remote, and this was the iClicker w, so you could do text entry, and you could do number entry, but you had these up and down arrows, which you had to click to go through the alphabet. So I do the type of clicker question where I like to give four statements on the screen, and I say, “Okay, well tell me if they’re true or false, and you have to click in all four.” So you would click in a string of T’s and F, so it’s like TTFT, or FFFT, whatever it might be. And so when I would do this in intro bio there with 440 students, it sounds like a swarm of locusts, all the clicking to get to the T’s and then someone says, oh, you should change it. Just make A be true and B be false? I said “Great idea, I’ll do that.” But now with the app, we lose the sound effects and iyou can just type in T’s and F’s and it’s a little bit easier to use.

John: One thing I haven’t tried with iClicker, and I do plan to do it this semester is allowing students to rate their confidence in their answers. Have you tried that yet?

Justin: I did just last week. So I just found out that was available this semester, and I gave it a shot. And it was kind of fun. Like the first day I turned it on, they’re like, Oh, look at this, this question was 80% confident, and now it’s down to 40% confident and it kinda reflected the percent answers that were correct. So like the one that was 80% confident it was a single multiple choice answer. And it was pretty much most people got it right. The one that was lower confidence, like 40%, was a multiple select answer. So they had five options, but two or three could have been correct. And so the confidence goes way down through a different question types even. So, I think it was really fun for a day or two, and then kind of the novelty wore off, unfortunately. [LAUGHTER] So I’m going to try to revisit it maybe more in targeted times and targeted questions rather than doing it for every single one. But it was fun to try it. I’d encourage you to do it, too.

John: One of the reasons I was considering it is that it might help students improve their metacognition a little bit by reflecting on how well they thought they knew something and then getting fairly immediate feedback on whether their expectations about how well they knew it actually matched the response, [LAUGHTER] or the feedback to the response.

Justin: Absolutely.

Rebecca: When you’re using clickers, are you also using strategies like think-pair-share as part of your implementation?

Justin: Yeah, absolutely. And there’s that sweet spot of clicker responses that lead to that. So the best practices, I’d say, and a lot of this work came from Carl Wieman Science Education Institute, which I believe is still housed through Vancouver, British Columbia, but he’s at Stanford now. But there’s this great flyer they made like this trifold flyer that kind of walks you through how to use clickers properly, or best practices suggested, and then what are the possible outcomes? Typically, you’d start off with that silence. Okay, click in on your own at first, I tell them I want to hear crickets, just click in by yourself, and then I’m able to see on the app the distribution and so at that point, there’s typically kind of three outcomes. So one is maybe 80-90% have the correct answer. At that point I’ll say “Okay, let’s move on.” But I make sure to take time to have students respond and say, “Okay, well, why is it C?” or to have a little discussion about why it’s not the other answers. Because even though you get 90% correct, there’s still 10% of students who got it wrong. So we want to make sure that everyone’s on the same board. The next option is usually that kind of random distribution. Let’s say if it’s a multiple choice question, you get ABCD each are in the 20 to 30% range. At that point, I call that Hmmm, what’s going on? Was it a really hard question? Did I goof the question? Is there a chemistry exam this evening, so there’s some reason why maybe it didn’t click? And then what I call the Goldilocks case is when you get the kind of 50-50. So maybe you’re split between two answers. And I love actually, when it’s exactly 50-50, I’ll show that on the screen. But sometimes I don’t, and I’ll say “Okay, at this point, now, you’ve all had a chance to try on your own, now talk to each other.” So that’s kind of the think-pair-share that’s built into the clicker there. So this is peer instruction at its best. This was pioneered by Eric Mazur at Harvard, people like Jenny Knight at CU Boulder have studied this. And she actually has a Science paper with Carl and a few others that showed when students are doing this… So you give them some quick information on their own. Don’t show them the answer, have them talk to each other. They put a bunch of microphones around the lecture halls at CU Boulder, and they listened into their conversations. And they actually found students are legitimately teaching each other and debriefing the topic, discussing it, tearing it apart. It’s not just the one student says, “Oh, it’s A ,everyone else, click A.” They’re actually debating it and talking about it, so that you get that true peer teaching and peer instruction going on. And then typically, you see everyone moving more towards the positive correct response that you’re looking for, at which point you can say, “Hey, look, you don’t need me as your instructor, you’re teaching each other. You’re doing great. Kudos, keep up the good work.” Yeah, there’s so many ways to riff on clickers and use them in different respects. Whether it’s the more traditional question types, or now the more advanced question types, and no matter how you do it, you’re getting students more engaged, they’re having more fun with it. And fun actually is a word they use with clickers. I have a paper a few years ago from the HABS educator where I looked at clickers vs. Kahoot!s, and students rated Kahoot! and clickers both equally fun, where Kahoot! being the more gamified version with trophies and a podium and music and sound and stuff like that.

John: And both Eric Mazur and Carl Wieman and some co-authors had done some experiments on the use of clickers with that methodology with answering it individually and then discussing it and voting again. And they found some really substantial learning gains in both of those studies. And we’ll include links to those in the show notes. In all areas, we’ve been seeing some significant equity gaps, but I think since COVID, we’ve been seeing much worse equity gaps in terms of students because learning losses were pretty pronounced everywhere. And that’s especially in math and in the STEM fields, but they were especially large in lower-income communities where schools were not as well funded and where students did not have the equipment and so forth, needed to thrive as effectively in remote instruction. One of the things that some institutions have been using increasingly is co-requisites in place of prerequisites to help students who want to pursue a major in a STEM field, but who would otherwise fall way behind or take many years just to get up to the basic level of math needed for the entry level courses in the discipline. In 2021, though, you had done a study that did a comparison between the effects of prerequisites and co-requisites. Could you talk a little bit about that study and what you found?

Justin: Yeah, absolutely. We saw the same thing probably everyone else did with students struggling, returning from online instruction in high school and having online instruction here. I taught remote synchronous for three full semesters, even though at Mines we stayed open for business pretty much the whole time with in-person classes, just lower capacity. I had prior online instructional experience in my career, so I volunteered to do those online sections for our department. But with the co-rec/prereq issue, I think that’s really important to consider for a lot of reasons. And this work really started when I was at Irvine with Brian Sato and Pavan Kadandale and a few others, looking more in the biological sciences and “do prereqs matter?” It was kind of our big research question. And then I carried that over to Mines and applied that to chemical engineering too. The short answer is: it depends. So first of all, and kind of why do we even have prereqs or co-reqs? A lot of it seems to be more of a management thing. So if we want to control class sizes, moving from first year to second year, and so on, and so forth. But there’s definitely an idea of well conceptual understanding and carry forward for if you have Bio I, well, those skills you develop could be used and count for something when you get to Bio II or same thing with the calc series or whatever it might be. However, we don’t know. It’s unfortunate that I think programs don’t sometimes look at those connections, that vertical alignment, if you will, between courses in terms of prereq to the following class, or with the co-req issues. At Mines, what I did with the paper you’re referencing, John, in chemical engineering, we have these two courses. One is called material and energy balances, MEB, I’ll call it for short. And that’s kind of like our intro bio version for chemical engineering. It’s kind of like a survey course that covers a lot of different topics, gives you some foundational skills that you’re going to need as a chemical engineer. We also have introductory thermodynamics, and an intro thermo, it’s related to MEB, covers some same conceptual understanding and problem-solving skill development, but it’s more on the nature of energy, and that transformation understanding. So typically in chemical engineering curricula, and I’m getting in the weeds here, so apologies for anyone who’s tuning out cuz you’re not a chemie, but MEB comes first, that’s typically either the fall of sophomore or spring of sophomore, you take that. First, it’s kind of like your gateway class, and then that’s a prereq to intro thermo and everything else you take. At Mines though, we do a little bit different. Mines, we do intro thermo first, fall of sophomore year, and then in the spring of sophomore year, you take MEB and coming from that background myself as a student at Penn State, I wish I would have had that way because intro thermo is the more… I use the word gentle… it’s a gentler introduction to chemical engineering than material energy balances is. But the idea here is that you can take thermo as a prereq in the fall or as a co-req in the spring with MEB. So the natural question came up… it’s a nicely well organic experiment to test is, well, if you have the thermo as the prereq do you do better than if you take thermo as a co-req with MEB. And this has implications for advising and its implications for progression through our major through repeating classes, all sorts of things. So it’s a really worthy study and my student, Jordan Lopez, at the time, he was an undergraduate student in mechanical engineering, and I love working with undergraduates on these SOTL and DBER projects. Jordan came along with me for this we did a quantitative assessment to figure out okay, well if students in MEB, did you have thermo as a prereq or co-req? How’d you do in MEB? And then we also asked the students qualitatively “Okay, well, do you think having thermo as a prereq or co-req matters? And if so, what do you think? And what we found was there was actually a big deal. Students who took thermo as the prereq did significantly better in their overall course performance in MEB than if they took thermo as a co-req, and that’s using linear regression models controlling for incoming GPA and things like that. Students also felt the same way. They felt that if you have thermo as a prereq, you would do better than having thermo as the co-req with MEB, and again, the quantitative data bore that out. The reasons they gave for that was because they get some opportunity to get more familiar with the discipline, with how we approach chemical engineering, how we do problem-solving skills, and having that foundation in the prior class allows them to do better in the follow up MEB course. In this case, it mattered, prereq vs. co-req. However, in our studies at Irvine, with Brian and Pavan and others, we found it didn’t really matter so much whether you took for example, microbiology lecture before after microbiology lab, you would think those two would be highly correlated one as a prereq to the other, it didn’t really matter in the result. Same thing with anatomy and physiology sequences, it didn’t seem to matter too much, in other papers in which we cite in these studies looking at organic chemistry sequences, economic sequences, it’s kind of hit or miss with whether prereqs matter or not. Long-winded segment here, but I think we as programs should be taking careful look at our prereq sequences and core sequences in general to see what, if anything, our students carrying over from one course to the other, and maybe we should loosen that up a little bit, because if they don’t matter, that can help students be a little bit more flexible with their degree planning, and time to graduation and things like that.

Rebecca: Speaking of prerequisites, faculty are often complaining that students don’t necessarily recall [LAUGHTER] information from prerequisites as they go into a sequence like we might expect. In 2018, you conducted a study that investigated the effect of physiology prerequisites on the future anatomy and physiology courses. Can you talk a little bit about that study and what you found there?

Justin: Yeah, so that was what I was alluding to there, Rebecca, with some of the work I did with Brian and Pavan. And in those cases, there wasn’t too strong of an effect, if anything, with the sequencing and the ordering that students took these classes. At Irvine, we did have human physiology as a prereq to human anatomy. I know that sounds a little funny to those of you in the A&P space. But the reason we did that was because of kind of a controlling the size of things. Our physiology course there was a lecture-based course, it would have 3-4 hundred students in it every quarter… talking about over 1000 students a year taking this class, versus the anatomy class, which had a lab, we can only handle about 144 per quarter, so availability of seats in the human anatomy was much, much lower than physiology, and also not as many students wanted to take anatomy versus physiology. So that’s kind of why that ordering existed. And so we tested that, though, looking at with what Brian and Pavan and I came up with, we call it a familiarity scale. How do you do on questions that are based on how familiar you are with the content based on the prereq? What we did was we had the prereq instructors look at the follow up course exam questions and write them as very familiar or not familiar based on basically whether it was covered or not. And then we looked at student performance on those questions based on having the prereq or not, and we didn’t see much of a difference based on the very familiar versus not familiar questions. The way we designed those studies, we didn’t come up with any strong conclusions, again, on the biological sciences side saying that, yeah, these prereq sequences matter. But on the chemical engineering side, which I just described, that seemed to totally make a difference, the ordering of the classes.

Rebecca: It seems like it’s really important to think about why we’re structuring the curriculum in the way that we are. And is it just traffic control? Or is there actually a legitimate reason why we’re hoping that they are scaffolded in the discipline?

Justin: Yeah, I think it’s reality, a little bit of both that happens, which makes sense, kind of have that traffic control, but also making sure that that alignment occurs through our new programs or existing programs, and just taking the time as a program or department every so often to say, hey, let’s look back at this and see, why are we doing it this way? Things need to change in this modern day.

John: One thing I wonder a little bit, though, when instructors are complaining about how little students remember from the prerequisite courses that they’ve taken earlier, is how much of that may be due to the incentives provided to students. The way many courses are structured, not in the sense of the structure you were talking about, encourages students to do a lot of cramming before the high-stakes exams. And we know that that results in very little long-term recall. Might some of these issues be resolved if we could encourage students to adopt better learning strategies, and if we could design some of our courses at the lower level, perhaps, to build that in, using the type of structure that you’ve been talking about? Because at least from what I’ve seen, that’s not so common? You picked up this stuff fairly early, but I don’t think that’s part of the training of most of the faculty in STEM fields or in most disciplines.

Justin: Yeah, I agree with that. And there was even in 2018, I believe, in Science, a paper, I think they call it “The Anatomy of STEM Education in North America,” it was something along those lines, where they looked at a big survey a big swath of courses and trying to see who’s using Active Learning who’s not, they use the COPUS protocol, the observation tool to characterize what’s happening in the classroom, and they broke it down in these seven different buckets. And even at that time, a very small percentage of the courses surveyed in STEM were taught using these student-centered strategies, not necessarily high structure, but the active learning, student-centered ideas. But I completely agree with you, John, if we can get more faculty on board with using these types of evidence-based practices, which yes, it takes some time, takes some energy, takes some foresight to develop these courses. But you do the same thing with your research, it takes your time and energy and careful thought to put in your research experiments. We should put the same energy into our classes too. And if we can do that at the early stage, which again, there’s such a huge issue with loss of learning. Not only that, but also lots of students from the early stage. There’s a paper after paper for these bigger courses, taking them as quote unquote gateway classes, we get a lot of attrition at these levels especially of students who might not be as well represented in STEM. We can add high structure. We know that works. We know that helps students do better and succeed. It might not work the first time, don’t get frustrated everyone. There’s a great paper from Anne Casper and Scott Freeman about having True Grit with being able to try and try again. So in her case, she tried adopting high structure at a smaller school in Michigan, it took her about three tries to get the right formula for it to work for her students to see success. And that paper documents that trial and error over a few semesters. But if we can use these types of methods in our classes, ideally, our students are going to be better prepared then for future classes. I do these things called Reading guides, which again, another shout out to Kelly, I got a lot of inspiration from her at Carolina for these, these are just Word documents that I make. And I have a bunch of these on my professional website. If anyone’s interested to download them for free, go for it. They’re just Word documents that help students read the textbook and again be more transparent with what I want them to know. So it has them define terms, fill out tables, make little drawings, they answer checkpoint questions in the text, summarizing things in their own words. And with the reading guides, we’re able to help students again acquire that content and then use it in the class as needed. I’ve had students in follow-up classes say to their instructor, “Well, where the reading guides at?” And they’ll come to me like, “Hey, what are these things? What are they talking about?” So the point being with that story, though, is that I tell students that “Hey, even if you go to a follow-up class, where it’s not highly structured, you’ve developed so many great metacognitive skills, you’ve developed so many great self-regulated learning skills through this class that you can then apply it and add your own structure to follow-up classes, if needed. And these are the kinds of tips that I love working with faculty about to try to help them transform their classes when I visit a campus and do a workshop or work with faculty one on one or on Zoom or whatever, trying to take these practices, which again, are rooted in the evidence, they’re rooted in the literature, but we have to tweak them to your own personal situation, your own student body, your own courses and demographics and everything. You all know your students way better than I do. What I try to do is combine what I know from the literature and the evidence. And that says a lot of this is in the book I’m writing on high structure, it’s going to guide you through the course-design process, a lot of practical outcomes and deliverables. But you got to tweak it and match it with again, your unique circumstances to achieve those positive outcomes.

Rebecca: I think one of the nice things about introducing students to some strategies for high-structured learning and retaining information is that if you have things like your reading guide, and they show it to another instructor, now they might request that of their instructor and the other instructor might decide, “Hey, this is a good idea. This is a strategy I want to adopt too.” And that’s some of the best ways to get some of these techniques to spread.

Justin: It really is. It’s that camaraderie building through seeing each other’s practices, seeing what’s going on. I’ve been part of a project here at Mines since I got here almost six years ago now where we’ve been working on kind of revising how we evaluate, and what we consider effective instruction to be. So we’re trying to take a more holistic review of how we take into account the best practices of teaching and student learning. And one of the big pieces there is peer observation. So we’re actually rolling that out, as of this week and last week with doing departmental trainings and helping faculty see how we can do peer observation to learn from each other. I learned so much from going into another person’s classroom or looking at their Canvas site, or their syllabi or their materials. And I really got this from Malcolm Campbell, who was at Davidson College in North Carolina, when I was a postdoc, this is going back 14 years or so. And Malcolm told me once on the phone, he said, “Find someone who you consider to be a master teacher, and go watch him teach.” But he said “don’t go just once, go a lot. Once a week, if you can for several weeks, and you’ll get to see them handle different situations, you get to see the ups and downs of the semester, you get to see what it’s like on the day where the midterm gets passed back. Or you get to see what it’s like when they’re getting to a really difficult topic or there’s some kind of disruption that class and how they handle it.” That’s the one great thing about peer observation is that if I go to your classes, sure, I’ll be able to give you some comments or feedback on what I saw, but I’m going to learn probably more from seeing you two teach than whatever I could give you and then I’m able to incorporate that into some of my lessons and my teaching style. If we can just change that culture, make it a little bit more okay sometimes to talk about teaching, share teaching strategies, see each other teach and have fun with it really and learn from each other, I think that can go a long ways towards, again, improving student outcomes and helping them do better in all aspects of college and life.

Rebecca: I found one of the most fun opportunities for observations is doing observations outside of your own discipline. It’s really informative to see how people in wildly different disciplines approach teaching and the way that they operate their classroom. I remember visiting a dance instruction classroom when I was at Marymount, at my prior institution, and it was really interesting, it was fascinating to me about how specific and transparent every little move was and how to correct things and the anatomy that was being discussed and just the level of depth that you might not realize how something transpires in a classroom unless you’ve actually had the opportunity to observe it.

Justin: I’m going to play that some for my faculty Rebecca. I thank you, because that’s what we’re trying to do at Mines is not intra-departmental, but rather inter-departmental observation. So getting across the disciplines for sure. Because yeah, you learn so many different things. And even if you’re just going from mechanical to electrical engineering, there’s still a lot of differences between those types of courses, you might see what’s going on. And I’ve learned that myself, I’ve watched some economics instructors teach at Mines, no idea. I feel like I maybe should know this stuff to be a better financially literate person myself, but I learned so many cool ways about how they’re teaching, but I also learned some cool concepts.

John: We do have an open classroom project here on our campus, we keep hoping more people will open their classes and more people will attend. But the people who have participated have found it universally to be valuable. So we’re going to keep doing it, and we just hope to see it become more a part of the culture.

Rebecca: Sometimes just indicating to a faculty member that you’re interested in their content, and you just want to sit in because you’re curious is a great way to learn new content, and maybe get an opportunity to observe someone teaching. [LAUGHTER]

Justin: And yeah, I definitely pitch it that way. Like I want to learn from you. And you get some new ideas. And I feel like in that case, faculty are more than willing to have you in. Well, yeah, Best of luck with that open classroom project. I’ve seen those types of programs in the country kind of sometimes hit sometimes miss. But best of luck with that.

John: One of the things you’ve done is just some research or some experiments involving two-stage exams. Could you talk a little bit about how you implement them, and what you found in general? And how did students react to the two-stage exams?

Justin: Yes, so I’ll try to be brief on these because I could spend probably 45 minutes on these myself. But yeah, two-stage collaborative exams, or more affectionately called group quizzes or group exams for short. There’s been a ton of literature on this Jim Cook, UC San Diego, he really helped me get started in this about five years or so now. But it’s all disciplines. You look it up, and the one paper I have, you mentioned in the intro, there’s a lot of references to different STEM disciplines that use them and some non-STEM too. The idea, though, is that we push active learning, we push group work, we push collaboration, but then we assess you by yourself with a pencil and paper and a calculator on a piece of paper, so why not change the dynamic there a little bit. And the two-stage idea is that first you have students take an individual quiz or individual exam, and I personally have gone to a weekly quiz model with my high-structure courses. I don’t do midterms anymore, I don’t do finals sometimes even. I know that’s taboo sometimes, but it depends on the class and I might not even do that. My colleague in Irvine Adrienne Williams says with high structure by going to the weekly quiz model, instead of having these giant peaks of anxiety with the two or three midterms, we just have a smooth level of anxiety the entire semester, and spread it out a little bit. But, for me, group quizzes then, what they look like is students take the individual quiz, turn it in, then they get in a group, this is a predetermined group, they know who their group is going to be. And then I give them a group quiz. That group quiz in the paper that you referenced was an identical one. So they took the identical two problems. And this was a MEB material energy balance class. So it was just two numerical problems, problem solving. They did that again as a group. However, my other courses now I do a different quiz. It’s either an isomorphic question, so slightly similar, but a little bit different, maybe in intro thermo or if it’s biology or anatomy and physiology, completely different set of questions. Then they do it as a group. The reason we do this, again, was trying to get this collaborative piece in the group setting. But also, when do you find students are most excited to talk about a quiz or an exam? It’s as soon as it’s over, they go walk out, the hallways abuzz, everyone’s all excited, good or bad excited, but they’re talking. So let’s capture that energy and do it in the classroom through that group assignment. Now, the group quiz is usually a fraction of the weight. In the literature, you’ll see, it’s usually let’s say you call the whole experience 100%, the individual quiz, maybe 80%, the group quiz is 20%. But that can vary from 75 up to 95, however you want to do it. And again, they’re covering the same kind of concepts just in that group dynamic. And so when I did this the first time, I got some consultations from my co-instructors, Rachel Morrish, Dave Marr at Mines, and I was a little bit nervous to see how it would go. But it was a hit. It was an absolute blast. The energy in the room is one thing I cannot describe it strongly enough here through audio, it’s just you got to see it. The students are energized, they’re talking, they’re debating. They’re working through the problems together. They’re trying to figure out, I will use the F word here. It is fun. It is a very fun experience to see. I’ve had students tell me that after the quiz is over, like that was a lot of fun. Talking about spreading things on campus. This is one thing that has spread a little bit at least within my department of chemical engineering, a few other classes have been using them now. And I collected some data on this, which I published, showing that… which makes sense, there was no shock… but the group quiz score is higher than the individual score because you’re tackling this together right away. And then also though, students strongly preferred it. The affect, the positive attitude response was through the roof. Both of those results, these are replicated from other disciplines, they see the same kind of things. I think it’s a really nice way to promote that community in the class, show that you’re working together, add that active part to the assessment. However, I’ll end with saying there can be some resistance to this, especially from students who might feel like “hey, I can do it all on my own, I’m fine.” And then they have to work together with maybe some students, they don’t know as well. You might get some resistance from students saying that I don’t want to work with someone else, I wanted this on my own. So be prepared for that. Also, accommodations with testing, if you have students who get extra time, that can be difficult to manage. I will say though, from doing this now about five years and four different classes at Mines, I’ve never had a single issue with students and extra time. What I typically do is I’ll have students get the extra time for the individual part, then they come join us for the group part and have the normal amount of time because in that group setting the students with extra time, they’ve always told me and I always ask them, I say, “are you okay with this?” And they’re like, “Yeah, it’s fine to have the normal time because I’m in a group.” So just some things to be aware of, if you’re going to try them out. And again, I could go on and on with these, so if anyone wants to learn more, hit me up. I’m happy to chat with ya.

Rebecca: Sounds like a good day to visit a classroom, huh?

Justin: It’s an energetic day for sure. Although you might not see much teaching going on if it’s just the assessment part. But it’s fun to drop in and see what’s happening.

John: There is a lot of teaching going on in their second stage, though.

Justin: Absolutely.

John: In fact, when I first did it, I was so excited about it, I made a short video recording and sent it to Rebecca, so she could see the dynamics of that interaction.

Rebecca: And hear it.

John: It was just really, really different than going over a quiz, where some of them would be really happy, but not that focused. And the students who did poorly were generally pretty disengaged when we went over a quiz ift they didn’t do so well. But when they were explaining it to each other, it was so much more positive.

Justin: Yeah. And you’re right, the teaching is happening. It’s coming from the students to each other. Not for me necessarily, but it’s coming from them. And it’s so powerful to see… absolutely to hear that live.

Rebecca: But you’ve set up the structure to facilitate it. So therefore, you’ve done the teaching.

Justin: [LAUGHTER] Thank you. Yeah.

Rebecca: So we always wrap up by asking: “what’s next?”

Justin: Yeah. So for me, what’s next? You mentioned at the top, John, I have this new position, I’m Associate Dean of Undergraduate Studies. And I mentioned in passing, I have a side business I called Recombinant Education. I do workshops for faculty. I’m writing a book. For me, I don’t know what happened, but last year, I had a birthday the ends in zero. Things have been a little wonky in my brain lately. And I listened to Taylor Swift now, sometimes. I never used to, but I think a lot of people do that. So it’s not just me turning that age. But the point being is that I’ve been doing this enough time now that I feel like I have things to share. And I’m trying to do more of that. So I’m trying to, and I’m still nervous to do things like this kind of stick my neck out and even talk to folks like yourselves, but I want to share best practices with teaching and learning, specifically with STEM education, because I still hear from students and I still see it from time to time, students are just not getting the best classroom experience they should be getting. College keeps getting more and more expensive. Students don’t deserve to have less than excellent experiences, in my opinion. I’m doing what I can on my own to share these best practices. Someone called me a one man teaching and learning center, it’s probably a fair way to say it. One of my students said, “Oh, you’re teaching teachers how to teach,” and that’s, I guess, another fair way to say it. But again, I got the energy for it now. I kinda have this midlife crisis going on too where I want to make some bigger impacts on the world outside of my own bubble, whether it’s at the administrative level at Mines now or across the country, or even the world. So I love working with other faculty on all these different areas. And that’s what I’m trying to make a big part of my day-to-day life now. But I’m still in the trenches. I’m still teaching classes every semester, because that really keeps me rooted, lets me try some new things out, still doing the DBER work and the SOTL work, working with students and just trying to have a blast and do what I can here in the time I have left.

John: Well, thank you for joining us. And we’re really looking forward to that book. And I hope you’ll come back and talk to us again when the book is close to coming out. Or sooner.

Justin: I would be honored to come back anytime John and Rebecca and if both of you are ever in the Denver golden area, please let me know. I’d be happy to show you around out here.

Rebecca: Well, thank you so much for joining us. It was fun to talk to you and to hear about the fun happening in your class.

John: More F words.

Rebecca: Yeah, [LAUGHTER] a lot of F words.

Justin: Yes. [LAUGHTER] Thank you both. I appreciate it. It was fun.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

GANESH: Editing assistance by Ganesh.

[MUSIC]

332. Challenges and Opportunities

Faculty and administrators have been faced with new challenges and opportunities as higher education adapts to a rapidly changing environment. In this episode, SUNY Chancellor John B. King Jr. joins us to discuss strategies that colleges and universities can adopt to navigate a successful path forward.

After graduating from Harvard, Dr. King acquired a Master’s degree from Teacher’s College, Columbia University, and taught high school social studies. He later co-founded Roxbury Preparatory Charter School and served as a co-Director for five years. Under his leadership, students in this school attained the highest scores of any urban middle school in the state and closed the racial achievement gap. After acquiring his doctoral degree from Columbia and a law degree from Yale, he served as New York State’s Education Commissioner from 2011 to 2014. Dr. King left NY for a while to work in the Obama administration as Deputy Secretary of Education from 2015 to 2016 and joined Obama’s Cabinet as Secretary of Education from 2015 to 2016. Following his work in the Obama Administration, Dr. King continued to advocate for increased educational equity and access as President and CEO of the Education Trust.

Transcript

John: Faculty and administrators have been faced with new challenges and opportunities as higher education adapts to a rapidly changing environment. In this episode, we discuss strategies that colleges and universities can adopt to navigate a successful path forward.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is the State University of New York Chancellor John B. King Jr. He has a long history of involvement with education. After graduating from Harvard, Dr. King acquired a Master’s degree from Teacher’s College, Columbia University, and taught high school social studies. He later co-founded Roxbury Preparatory Charter School and served as a co-Director for five years. Under his leadership, students in this school attained the highest scores of any urban middle school in the state and closed the racial achievement gap. After acquiring his doctoral degree from Columbia and a law degree from Yale, he served as New York State’s Education Commissioner from 2011 to 2014. Dr. King left NY for a while to work in the Obama administration as Deputy Secretary of Education from 2015 to 2016 and joined Obama’s Cabinet as Secretary of Education from 2015 to 2016. Following his work in the Obama Administration, Dr. King continued to advocate for increased educational equity and access as President and CEO of the Education Trust. Welcome, Chancellor King.

Chancellor King: Thanks so much, excited to talk with you all.

Rebecca: Today’s teas are: Chancellor King, are you drinking any tea with us today?

Chancellor King: I am, sweet ginger citrus tea. And this is part of my New Year’s resolution. I’ve always been a tea drinker, but I also am a longtime coffee drinker. [LAUGHTER] But a New Year’s resolution this year was to put the coffee aside and switch only to herbal no-caffeine tea. So that’s what I’m working on.

Rebecca: Well, I’m glad that you decided to record this podcast then as part of your New Year’s resolution.[LAUGHTER]

Chancellor King: It fits in perfectly. [LAUGHTER]

John: And following that theme. I am drinking a spearmint and peppermint blend tea, as another herbal tea.

Rebecca: I may have noted that I was trying to cut down on caffeine in an earlier podcast, but I happen to have a Scottish afternoon tea today. [LAUGHTER]

Chancellor King: No…

John: Which is a bit more caffeine than breakfast teas.

Rebecca: Yeah, my accountability isn’t working well. [LAUGHTER]

John: There’s so many things we’d like to discuss with you. But given the time limitations of the podcast, we’d like to focus on your views of the challenges and opportunities facing higher education today. What do you see as the major opportunities in higher ed today?

Chancellor King: I think higher ed is foundational to the long-term success of both our economy and our democracy. We have vital roles to play in both. Certainly, we have tremendous opportunities in the state to prepare students for success in the semiconductor industry which is rapidly growing in the state, for success in healthcare where we have tremendous needs, success in green jobs, and some of the resilience work that we’re going to need to do as a society because of climate change, tremendous opportunity to prepare students for every conceivable profession, from teachers to writers to actors to artists. And, we have a crucial role to play in the health of our democracy. We’ve got to make sure that we are preparing all of our students with a rich liberal arts education so that they can be critical thinkers, so they can be critical consumers of modern media, so that they can be discerning, so that they can make decisions as voters, as neighbors, as citizens. And we’ve got to make sure that our institutions are able to meet both of those missions across degree programs.

Rebecca: What are some of the ways that we can move forward on some of those opportunities?

Chancellor King: Well, look, we were very fortunate that last year, Governor Hochul and the legislature made such a significant investment in SUNY, $163 million, the largest operating aid increase SUNY has received in 20 plus years. It allowed us to make double digit percentage increases in state support at all of our state operated campuses as well as to invest funds in mental health services, services for students with disabilities, internships, which is critical to preparing students for those transitions to career. We were able to put $10 million towards the expansion of research, which is another critical role of the higher ed sector in the health of our society. And we’re able to dedicate consistent funds for supporting our food pantries across our institutions, because we worry about our students are struggling with food insecurity. So one way we move forward is through continuing to invest in the strength of our institutions. Another important way that we can move forward on that agenda is continuing to adapt our offerings, our programs, creating new paths for students, very excited about the Governor’s announcement around AI and the creation of Empire AI and what will be a significant investment in SUNY’s ability to prepare students for research and careers and ethical use of AI, very excited about the new Stony Brook Climate Resilience Campus, $700 million campus that will be built on Governors Island, just off the coast of Manhattan. So we’ve got to continue to evolve as we respond to the opportunities and challenges for our economy and for our democracy.

John: Speaking of challenges, what do you see as the major challenges facing higher ed today?

Chancellor King: There are, unfortunately, a number of major challenges. Many of our institutions, certainly at SUNY, but private institutions in the state, higher ed institutions across the country, have seen significant declines in enrollment. And that was all exacerbated by COVID. That said, I’m a glass half full, tea cup half full, kind of guy. [LAUGHTER] And I look at that and I say, part of what we need to do is evolve our thinking about who our students are. We’ve got to make sure that we’re reaching out to every New Yorker to let them know there’s a place at SUNY. We’ve got to do more work to make sure that we are recruiting low-income students, first-gen students, Black and Latino students, indigenous students, immigrant students, that more of our veterans know that they can come back after their service and find opportunity on our campuses, that folks who are involved in AmeriCorps service programs know that there’s a place for them at SUNY, that our working adults know that they can come back to SUNY, whether it’s one of our community colleges or one of our four-year institutions, to complete a degree that maybe they started and didn’t finish. We’ve got 2 million New Yorkers with some credits, no degree, or maybe that they’re coming to a campus for a microcredential or a certificate, but we’re gonna then help them leverage that into a degree program over time. So there’s the challenge of declining enrollment, but there’s also the opportunity. We are already seeing progress at SUNY, this is the first year in 10 years that we had an enrollment increase across all sectors. But another major challenge is the attacks that we’re seeing on academic freedom, on teaching the truth about our history, the attacks trying to undermine our ability to talk about the hard parts of our history, the times we fallen short of the promise of American democracy, slavery, the horrific treatment of Native Americans in the way land was taken from them. That’s a part of our history. It’s just the truth, and we’ve got to grapple with those hard truths. But there are folks all over the country, unfortunately, who are trying to prevent discussion of those topics, even states where they’re saying they don’t want any higher end institution to mention the word diversity or the word equity. So that I think is very dangerous, and very proud that in New York, we are standing up for those values. We’re gonna be the opposite of Florida, and we’re gonna stand up for diversity, equity, and inclusion, but I worry a lot about that attack.

John: One of the concerns that many people have are these attacks on higher ed, that are convincing more parents and many students that college is no longer needed. Because, for political reasons, perhaps, a lot of people are arguing that a college degree is no longer useful. What can we do to help push back against some of those attacks that we’re seeing nationwide?

Chancellor King: Yeah, you know, there are a few things. And certainly, we have to make the value proposition clear. It’s important that students understand and families understand that over your lifetime, if you have a bachelor’s degree, it will translate into a million dollars more of earnings. So there is this very clear value proposition. We’ve got to take on the affordability question, which a lot of families worry about. You hear so much about the student debt crisis. So we’ve got to really help folks understand how affordable SUNY is. 53% of our students across our institutions go tuition free because of the Pell program and the New York state tuition assistance program as well as the Excelsior program. And our tuition, as you know, just over $7,000, is significantly less than many of our peer institutions in neighboring states. It really is possible to get an incredibly high quality education affordably at SUNY, and we have to make sure that parents and students understand that. We’ve also got to, I think, go back to first principles around what is the purpose and the vision of higher education. The fact of the matter is, you look at almost every indicator, life expectancy, health outcomes, you name it, they’re better for folks who have higher education. And what we’re aspiring to, is to say come to our institutions for an education that will help you lead a healthier, more fulfilling life. I want you to come to our institution and maybe take art history, and so your life is enriched because when you travel, when you go to a new city, you go to a museum and you discover insights around art that you otherwise wouldn’t have had. That’s the part of the beauty of higher education. So we’ve got to make the value proposition argument, the dollars and cents argument, but I don’t want us to forget about also making the richness quality of education argument as well.

Rebecca: As we think about broader access, and our student bodies becoming increasingly diverse in a variety of ways, we do see a number of historically minoritized students having lower retention and DFW rates. What can educational institutions do to reduce some of these equity gaps in degree attainment and not just starting?

Chancellor King: So important, and at the Education Trust, this was really a major area of focus for us, trying to make the case that institutions have a responsibility to not only recruit first-year students, but to provide the supports necessary for students to complete and go on to success after graduation. One of the things we’re working on at SUNY, as I think you know, because Oswego’s very much part of this, we are replicating across 25 of our campuses a program called ASAP for community colleges or ACE for our four-year institutions. And the idea behind ASAP and ACE which has been shown to be successful in doubling completion rates in randomized controlled trials, so it has a tremendous evidence base. The core strategy around ASAP and ACE is to provide supports that make it more possible for students to be successful: more intensive advising, cohort experience, help with just-in-,time financial assistance for the student who, the car breaks down and so then they can’t get to their job, they can’t get to class and for want of $250 for the auto mechanic, they end up dropping out of school. ASAP and ACE have shown that if you provide that just-in-time financial support, it can make all the difference. There’s also an effort to support transportation, so that you try to take that out of the way as an obstacle for students. And I’m very hopeful about the impact that ASAP and ACE can have across our 25 campuses. But, more broadly, there’s really a cultural commitment we have to make as a community of institutions, that we are going to be laser focused on helping our students complete with a meaningful degree or credential. And so when we see those high DFW rates in a class, we’ve got to ask, “Well, is there more we could do in terms of academic intervention? Is there more support that we can provide? Are we seeing patterns for students with disabilities where they’re not getting the accommodations they need? Are there opportunities to maybe have those classes structured differently, so that students are able to get some of the foundational support they need at the same time as they are tackling new rigorous challenges, what sometimes people will refer to as co-requisite classes that integrate the remedial work with actual credit-earning college-level work.” So we’ve got to just be disciplined about this. And we’ve got to invest in the programs that we know will make a difference. EOP has been fabulously successful in New York for decades. Again, a set of wraparound supports, a sense of community for students, and importantly, financial assistance.

John: Are there any specific types of interventions in the classroom that seem to be particularly effective in terms of reducing some of the equity gaps by race, by first-gen status, and by Pell eligibility.

Chancellor King: It certainly varies by discipline, but a couple observations, one is relationship building is critically important. Students need to know that you care, and they need to know that they can come for help. When I was teaching at University of Maryland College Park before I came to SUNY, one of the things I would do every year on my syllabus, I would include basically a basic needs statement to say, here’s where you can go on campus if you are struggling with food insecurity, or housing insecurity, or if you need additional academic support, or you need additional mental health support. And here’s my contact information and my TAs contact information, and I want you to reach out if you need help in these areas outside of our class. Of course reach out if you need help with the work in our class, but if you need help in these other areas, please let us know. And just that step of communicating to students, here’s where the resources are and I want you to reach out for help, can be quite powerful. So relationships are critical. A second one I would point out is, again, it varies by discipline, but opportunities for students to do projects, hands-on learning, we’ve seen oftentimes that when classes are only lectures and exams, that students may not get as engaged. And it may not be as accessible to students as it could be. It takes more time. It’s more complicated to design courses that build in project-based or experiential learning. But we certainly need to be thoughtful about that, as we design courses.

Rebecca: I love the examples that you’re sharing because they really underscore that sense of belonging a student might gain and really feel seen, acknowledging that, you know, students may be housing insecure means you belong here, we know that you might be housing insecure.

Chancellor King: That’s right. That’s exactly right.

John: One of the things that’s had a pretty profound impact on higher ed, or at least it’s raised a lot of questions in higher ed, is the rapid development of AI tools ever since the introduction of ChatGPT last year. And we’re seeing new tools coming out almost every week or modifications on the existing tools. How do you see this affecting how we teach students and how students learn? And how can we prepare students better for a world in which they’ll be working with AI tools that’ll be increasingly better developed.

Chancellor King: It’s a fascinating set of questions. And this, I think, is going to be an important area of discussion for faculties across all of our SUNY institutions for many years to come. I’m very excited that the governor committed to the Empire AI initiative, because that will invest real resources in our institutions to do some of the research to unlock the potential power of AI to advance the public good. You think about some of the opportunities where AI could help with medical diagnosis and the development of treatment plans in medicine… early days, but we see some opportunities there. We’ve got an NSF grant at UB, University at Buffalo, to focus on the use of AI as a tool for improving instruction for students with disabilities, and there’s tremendous potential there. We know that AI can be leveraged for advances in manufacturing and robotics, so tremendous opportunities to leverage AI. There are also tremendous risks. We have a set of scholars at UB as well, who are working on the issue of deep fakes, and the risks that deep fakes pose to our democracy and the good functioning of our society. We have a faculty member at UAlbany, who is a philosophy professor whose focus through the early part of his career was on trust between people, and now he is writing about and studying trust between people and machines, as we think about how AI is reshaping elements of our society. So lots of opportunity here for us on the research side, and also some very real implications for thinking about teaching and learning. Some hopeful things like how can AI be used to power personalized tutoring for students who may be struggling? How can AI be used to create adaptive learning experiences where the level of challenges match to how students are responding to questions, but also, I think, a very real fear. Will students be doing their own work? Or will they be using chatGPT to write their paper? And so it’s going to challenge us to think differently about the kinds of assignments we give and where students take those assignments. So lots of questions that I think all of our faculty have to begin to think about, but we can’t pretend it’s not happening, that it’s not changing how students approach their work. And so we’ve got to be responsive.

John: I’m going to put in a plug for an event that SUNY will be sponsoring. There’s going to be an AI symposium taking place in Buffalo on May 21st. We’re working on a schedule for that, and we will include a link to any information about that in the show notes for anyone who might be interested in joining a discussion with many people from around SUNY about the implications of AI.

Chancellor King: There’s so much excitement around this. We had an AI task force this past semester that is now ongoing, and we had probably 80 faculty members across SUNY institutions participating in that and that was thinking about lots of different questions about the implications of AI. But I think this is a great chance for us to deepen collaboration across the SUNY system.

Rebecca: You really highlighted a wide range of both opportunities and challenges that institutions face as a whole. How do faculty see themselves in moving forward in facing some of the challenges in helping students achieve meaningful credentials or really meet meeting some of the demands of our very near future.

Chancellor King: The faculty are the heart and soul of SUNY. I visited all 64 campuses, as I mentioned, last year. I’m about halfway through visiting them all again. And I’m just continually inspired by the work I see happening across our campuses, just faculty members who are inspiring students, who are equipping students with critical skills that will help them in their professions and in their lives. So I’m very grateful for that. A couple of places where I think there are some real leadership opportunities, one is for faculty to play a role in supporting our recruitment efforts to make sure that when students of color, low-income students, first-gen students, are coming to campus, they are hearing a clear message from faculty that they are wanted. One of the worries I have about the Supreme Court decision last year ending race-conscious admissions, is that it sent a message to black, Latino, Indigenous students, you are not welcome in higher education. And we want to send the opposite message, we want to say there’s a place for every New Yorker at SUNY. Our classrooms are stronger when our student body is diverse; our faculties are stronger when they’re diverse; our research is better when diverse researchers are engaged in solving problems together. So recruitment is one opportunity. Second opportunity, I think, is to continually ask how do we evolve our instruction and our course content to align with our evolving students in our evolving society? Now, we’re always going to want students to engage with the great conversation about what is the good life, we’re always gonna read Plato and Aristotle. But at the same time, we got to think about how are the questions we’re asking maybe different given what our students face today. So I think about when I was at one of our campuses, speaking with a botany professor, who was saying that he’d really never had full enrollment in his course, he always had empty seats. But this past year, he was teaching a course in the horticulture of cannabis and waitlists. And it wasn’t to say that every student in that class is going to get a job in the cannabis industry, though certainly the cannabis industry is going to grow in New York. But that course will be a gateway to getting excited about agriculture and an interest in careers in agriculture, which are plentiful as a whole generation of folks in the agriculture industry retire. We have lots of need for folks with expertise in agriculture, sustainable agriculture, in particular. So maybe being in that course on the horticulture of cannabis will bring them into this new field. So it’s not that he’s teaching something entirely different, it’s kind of tapping into the intersection of his discipline and what students are curious about. Similarly, you think about health care, and the challenges we have in the healthcare sector, students are really interested in learning about racial health disparities, and understanding how we’re going to tackle those. And I’m not saying diverse students are interested in those questions, because they see the horrific maternal health disparities by race that we have, and they want to make it better. So we should talk about that in our nursing classes, in our public health classes, in our medical schools. So this evolution of our teaching and our content to meet the moment, I think, is hugely important. And then I would add, we are stronger together. And so collaboration across disciplines, collaboration across institutions, strengthening transfer pathways, for example. 80% of the students who start community college, say they want to earn a bachelor’s degree, but less than 20%, do. We can do better, we have to do better. And so those partnerships, not only institutional partnerships, so that credits transfer and those things, but also faculty collaboration. What do we advise students about which courses to take if they’re interested in a particular degree when they come to the four-year institution? How do we improve advising at the two-year institution? Those kinds of things are an important place where faculty can engage.

John: As you mentioned, SUNY has done quite a bit of work in easing transfer credit across institutions, between community colleges and four-year colleges. But we have those really poor success rates for students who plan to go on for a bachelor’s. Are there any other strategies that could be used to help ease that transition from community college into four-year programs?

Chancellor King: Absolutely. You know, we have a transfer task force with folks from across our two- and four-year institutions working on this set of questions. Some of the things that we’re seeing that are promising around the country: advising… crucial, particularly as you’re picking classes, as you’re thinking about your major and how it will translate into what you want to ultimately do in your career, improving advising at the community college level, particularly if, and we have some folks who are using transformation funds, some of the funding we got last year from Governor Hochul and the legislature to do this, particularly if you can get the four-year institution to either place their staff as the advisors on a two-year campus, or to work in very close partnership with the advisors on the two-year campus to help ease that navigation. Another issue is what I might describe as friction reduction. One of the things we started this past year, which we will continue to grow is a SUNY match process where we reach out directly to students in our two-year programs and saying, “You are directly admitted to these four-year institutions based on your academic record at the two-year institution,” because for a lot of students, especially first-gen students, it’s that feeling of “Well, college, it it really for me, is a four-year institution really for me, am I ready for a four-year institution.” But it can be transformative to get that letter, that personalized letter that says there is a place for you at the four-year institution. And then look, there’s lowering financial barriers. That’s critical. One of the things I’m excited about that the governor announced in her State of the State and included in her budget is Universal FAFSA, making sure that students complete the Free Application for Federal Student Aid, because that’s how they know what resources are available to them. And some of our community college students, unfortunately, they don’t realize the aid they could have and so they’re struggling to afford the two-year institution and making the choice not to pursue a four-year degree because they don’t know the Pell dollars, the TAP dollars that could be there for them. That’s why we need them to do the FAFSA. Last year in New York, students left $200 million in federal aid unclaimed because of not completing the FAFSA. And so Governor Hochul wants to require K-12 to work with us in higher ed, to make sure that every student either completes the FAFSA, completes the DREAM Act application if they’re undocumented, or they and their family would complete a waiver that says “I realize there are billions of dollars available for post-secondary education, and I don’t want any. I’m not gonna fill out the form.” But at least we’ll know that every student and family understood the options available to them.

Rebecca: Sounds like some really great opportunities. I’m watching our time and knowing that we’re nearing our end of our time. But I’m really curious, before we get to our last question, what you’re most excited about working on in the next year?

Chancellor King: I love that question. I’ll tell you one of the things that I’m very passionate about. I first worked on when I was at the U.S. Education Department, President Obama had an initiative called My Brother’s Keeper, which was about trying to improve outcomes for boys and young men of color. And as part of that initiative, I was very involved in kind of leading the agency work on that initiative when I was Deputy Secretary then continued that as Secretary. And one of the initiatives that we launched was something called Second Chance Pell. And the history there is that in 94 in the crime bill, there are many problematic provisions, but one that was especially dumb was a provision that banned access to Pell grants for folks who are incarcerated. Now, of course, the evidence is any educational experience while incarcerated reduces the likelihood of recidivism. And completing a degree while incarcerated dramatically reduces the likelihood of returning to prison. So shamefully, this was part of the tough on crime punishment first kind of focus of the mid 90s. They banned access to Pell Grants, as a result programs in prisons all over the country closed. Some remained open through philanthropy, but many many closed. We wanted to change that, and so we used our experimental authority under the Higher Education Act to create a pilot program called Second Chance Pell that would allow, at that time, 65 colleges and universities to use Pell grants with students who are incarcerated. We launched that while I was Secretary. And then, when I was at Ed Trust, a coalition of civil rights groups, criminal justice reform organizations, education equity focused organizations worked together to get folks to visit those programs, members of Congress, Governors to highlight the incredible stories of the students who graduated from higher ed in prison programs. And we were able to persuade Congress to change the law and restore Pell access generally. So today, Pell Grants are available for incarcerated students. SUNY is already the largest provider of higher education in the state’s prisons with over 700 students, but we are trying to grow that effort. I want there to be a higher education program in every correctional facility in New York State. I want to make sure that we grow the number of bachelor’s programs. We have a lot of associate’s degree programs, but I want to make sure that students have the opportunity to go on to their bachelor’s degree. I was at graduation last week, mid-State Correctional Facility, five students graduating from Herkimer Community College. It was so beautiful and inspiring to see the transformative power of education, to hear students talk about how the access to higher education had changed them, changed their lives, changed their prospects for when they come home, but changed them as people. The faculty members were crying, the family members were crying, the folks in the correctional facility were so excited for the students who were graduating. It was truly, truly inspiring. So I’m very excited about that work. I’m looking forward to growing that work. But then more broadly, I’m excited that SUNY is on the move. SUNY is delivering high quality, affordable public higher education, driving economic opportunity for New York State. We are working to improve recruitment, retention, and completion. We are advancing diversity, equity, and inclusion. We are doing the things that we ought to be to better serve New Yorkers. So I’m super excited about our work together.

John: Those are really important programs. And we’re so glad to hear all of this. We always end with the question: “What’s next?” I know you’ve already addressed a lot of this, but there’s so much more.

Chancellor King: Well, you know, we try to organize our work around the aspiration that SUNY has to be the best public statewide system of higher education in the United States. And we’re the largest comprehensive system, but it’s very important that we work to be the best system. To me that means we’ve got to deliver on student success. We’ve got to deliver on research and scholarship, the Governor’s asked us to double research and scholarship across the system. We’ve got to deliver on diversity, equity, and inclusion, that means diversity of our students, our faculty, our leadership, across our institutions. It means implementing the diversity, equity and inclusion, general education requirement, which is really nation leading to say every student is going to be exposed to diversity, equity, inclusion content across all of our institutions. And we’ve got to deliver on economic development and upward mobility, which has been the SUNY tradition for 75 years. So I organize how I think about the work. And certainly our board is organizing its work around those four pillars in order to achieve that goal of being the best statewide public higher education system. In the short term, we got a state budget that hopefully will be enacted on April1. So we got a lot of work to do to make sure we are making the case for investment in SUNY and helping people to see there’s a nine to one return on each state dollar invested in SUNY in terms of the economic impact. We need legislators to know that and we need to work with them to make sure that they are investing in the great work that our faculty are doing.

Rebecca: Well thank you so much for your insight on the current state of higher ed and all the opportunities that we have to improve our society.

Chancellor King: Thank you. Thanks for the opportunity to join you and thanks for fostering dialogue on important issues.

John: And thank you for giving up your time so generously and all the work that you’ve done and are continuing to do.

Chancellor King: Thanks so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

329. Admission to Highly Selective Colleges

Graduates from a small number of elite private colleges account for a disproportionate share of America’s business and political leaders. In this episode, John Friedman joins us to discuss his recent study with Raj Chetty and David Deming that examines how admissions criteria at these institutions privilege students from high-income families.

John is the Briger Family Distinguished Professor of Economics and International Public Affairs at Brown University, where he is the chair of the Economics Department. He is a Research Associate at the National Bureau of Economic Research and has served in the White House as Special Assistant to the President for Economic Policy at the National Economic Council. John is also a member of the U.S. Treasury Council on Racial Equity, a co-Editor of the American Economic Review, and a founding Co-Director of Opportunity Insights.

Show Notes

Transcript

John K: Graduates from a small number of elite private colleges account for a disproportionate share of America’s business and political leaders. In this episode, we discuss a recent study that looks at how admissions criteria at these institutions privilege students from high-income families.

[MUSIC]

John K: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by

John K:, an economist…

John K: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John K: Our guest today is John Friedman. John is the Briger Family Distinguished Professor of Economics and International Public Affairs at Brown University, where he is the chair of the Economics Department. He is a Research Associate at the National Bureau of Economic Research and has served in the White House as Special Assistant to the President for Economic Policy at the National Economic Council. John is also a member of the U.S. Treasury Council on Racial Equity, a co-Editor of the American Economic Review, and a founding Co-Director of Opportunity Insights. Welcome.

John F: Thank you so much for having me. It’s a pleasure to be with you.

Rebecca: Today’s teas are: … John, are you drinking any tea with us today?

John F: So, I’m a big tea drinker…

Rebecca: Yay!

John F: …but, I drink tea in the morning. And so I had a delightful Hunan tea this morning, which I will draw on the reserves of that energy throughout this conversation.

Rebecca: Well played. [LAUGHTER]

John K: And I am drinking a ginger peach black tea from the Republic of Tea. Not so fancy, but I enjoy it.

Rebecca: I have an Awake tea because I also need some energy. [LAUGHTER]

John K: We’ve invited you here today to discuss your 2023 working paper with Raj Chetty and David Deming, “Diversifying Societies leaders: The Determinants and Causal Effects of Admission to Highly Selective Private Colleges.” This paper created a big stir in higher ed and other circles as well. You note in this study that less than one half of 1% of college students attend Ivy plus institutions. While most of our listeners will be familiar with Ivy League colleges, what are the other colleges that are included in the Ivy plus designation?

John F: Thanks. And it’s helpful to clarify up front, the colleges that we’re directly studying are the eight Ivy League schools: Harvard, Yale, Princeton, Dartmouth, Brown, Columbia, Princeton, Penn, and four close peers which are Stanford, MIT, Duke, and Chicago. The important thing to know here, you’re right, that there’s a pretty small share of students, it’s not that something changes discreetly, when you move out of that group of 12 schools, and you go to another outstanding private institution like Northwestern or Johns Hopkins or something like that. We have some data, it seems like there’s some pretty similar things going on across a lot of these very highly selective private institutions. Where you do see things being quite different, where we have some data as well, is at the most elective public institutions, places like UC-Berkeley, University of Michigan, UT-Austin, places like that.

John K: You still have to draw the line somewhere when you have prestigious institutions.

John F: That’s right.

Rebecca: So you noted that these institutions enroll a small share of our students, why are they so important? Why do we need to study them?

John F: That’s right, less than 1% of college students in the country go to one of these schools. And, of course, college students themselves are just a small share of students born in any given cohort. What we found, though, was that students from these institutions are really highly over represented in leadership positions in society. You see that if you look at who’s at the top of the income distribution, or who’s a CEO of a Fortune 500 company. More than 10% of those individuals are from these Ivy plus institutions. But it even gets higher when you look at who’s in the U.S. Senate. About three-quarters of the Supreme Court justices over the past 50 years have come from the schools. And so for sure, the schools themselves are not going to be making broad scale changes in upward mobility in our society. They’re just too small. But in terms of creating both a diverse group of leaders and a broad set of pathways, where children from any background have the chance to be a Senator or Supreme Court Justice, whatever, these schools are incredibly important.

John K: One of the things that your study did is it investigated questions that couldn’t be investigated before because of the data that you were able to assemble. Could you tell us a little bit about the data set that you use?

John F: Sure, our study, like so many others, has been the beneficiary of the big data revolution. It’s affected so many aspects of society, and this is the academic part of it. We’re merging together datasets from three different places. The starting point for this paper and for many of my other research is the universe of U.S. tax and census records, which have been merged together at the US Census Bureau. And what that allows us to do is to identify individuals when they’re kids and then actually follow them through to not just project what we think their outcomes might be, but really actually observe them after they get out of college and they’ve entered the labor force. Those data are incredibly important in terms of measuring upward mobility directly. Then, on top of that, in order to study really in depth what’s going on at these institutions, we have internal admissions data from several Ivy plus colleges as well as a bunch of these most selective public universities and university systems. And we see where children are coming from, or where they grew up in the tax data, we see where they end up in the tax data, the college data are really filling in this in between, how do they go through the college application process. We both learn a lot of other information about them, like where they applied, there’s a lot of detail about the evaluations of their applications, as well as of course, whether they eventually get in and matriculate. The final data that we’re using is a set of standardized test scores from the two main testing companies: College Board that runs the SAT, and then ACT, which runs the eponymous test. And the way we use those data are to start from a baseline of academic achievement at the point when these students are applying to university. And we can talk about how that works, and of course, it’s not a perfect proxy for where students are. But when we think about the role that universities are going to be able to play, we just have to be realistic about the fact that they are starting to interact with students when they’re 17 or 18, and there’s a whole lot of inequality in our country that’s going to affect students long before that. And so we talk, of course, as a policy matter about how to deal with all that inequality. But the reality of the situation, especially at this highly selective level, there are going to be some students that just aren’t academically prepared. So that’s going to shape the set of students that these colleges can recruit or admit.

Rebecca: One of the main questions that you address in the paper is: “Do highly selective colleges amplify the persistence of privilege across generations by taking students from high income families and helping them obtain high-status. high-paying, leadership positions?” What do your results suggest?

John F: So that’s exactly the kind of broad goal of our paper, to answer that question. And I think, unfortunately, the answer is that on average, yes, they do amplify the persistence of privilege. That comes from two different parts. So first of all, the students who attend these colleges, we measure a pretty large causal effect on their outcomes, specifically in these leadership positions as adults. Of course, the students are very highly selected when they come in. And so even if the college’s weren’t doing anything, you’d expect these set of students to be doing some impressive things afterwards. But what we find when we talk about more of the details of how we do this later, there’s a very large causal effect. And so these universities, it’s not just that a large share of senators come from them, they do seem to be a very important pipeline effect, where it’s really propelling students up into these leadership positions. Now, on the admission side, who are the students that are coming into this set of institutions that are benefiting from this really positive effect? The problem here is that even relative to the distribution of test scores for high school graduating seniors, which as we talked about before, exhibit a whole amount of inequality due to differences in education and neighborhoods that different students from different backgrounds have been exposed to before they’re applying to college. Even just looking at students that have the very same test scores, high-income students are substantially more likely to be admitted to and attend these institutions, relative to lower-income students, and especially middle-income students. The gaps are largest when comparing students from very high-income families to students from middle-class, upper-middle class families.

John K: And in your study, you tie some of this selection process to athletic scholarships, to legacy students, as well as attendance at private high schools. Could you talk a little bit about how those factors influenced the decisions?

John F: Sure. So the approach that we take is a decomposition of this pipeline, we see that students are coming in with, let’s just say everybody has the same test score, a group of students at the beginning, we see that the students from high-income families are more likely to end up attending this set of schools at the end of the day, and we’re going to try to decompose where in the pipeline these disparities are emerging. And so the way we first start is actually at a somewhat higher level than you asked the question, which is just to decompose these differences between the application phase, which of the set of students with a given test score applies to these institutions, the admissions phase of those students with that given set of test scores that applied which are admitted, and then the matriculation or the yield phase of those that are admitted whose actually going to choose to come at the end of the day? And what I found interesting coming into this project is that there are many different analyses or ideas about how each of those three phases could be affecting it. There’s concerns about who has the information or the resources to apply. There’s concerns about potential biases in the admissions process from some of the factors that you mentioned, legacy preferences or private schools. And there’s a concern that maybe schools aren’t offering financial aid that’s sufficient in order for students from less affluent families to attend. In our data, we see that about two-thirds of that entire disparity is coming from the admissions part of that alone. So that’s not all of it. But I mean, just to give some numbers, there are about 250 students from the top 1% of the parental income distribution who are in an average starting first-year class, that’s about 1650 students. So right there, about 15% of the class is coming from the top 1% of families. Of those 250, we find that about 160 of them are extra in the sense that if everyone attended at the same rate, when they have the same test score, there would only be about 90 students from the top 1% of families. And so then of that 160, about 100 are coming from the fact that high-income students are more likely to be admitted. There are smaller effects coming from differences in application rates, even smaller effects coming from differences in matriculation rates. But primarily, the differences are coming through the admissions process. And even before we get into specific policies, I think that that decomposition is incredibly important, because the admissions process is the one part of this that schools entirely control themselves. If you want more people to apply to your school, that’s hard, because applications are the students’ decision, you have to go out and convince a bunch of students to apply. If you want to get more students to yield, to matriculate, you have to convince those students, it’s their decision. The choice about who to admit, it’s just the school’s choice. This is the one lever that the schools entirely control. And so the fact that most of the disparities are explained by this set of policies, on the one hand, maybe that’s a good thing that they control, and maybe can directly fix what is the source of the problem. On the other hand, it’s a little bit discouraging that it’s in the choice of these own universities that these disparities are being created, despite what are typically loudly voiced concerns for upward mobility. So it’s really the admissions process that matters. Now, we then go down to the next level. and this gets to the factors that you mentioned. Why is it that a high-income student with a 1400 test score is going to be admitted at a higher rate than a middle-income student or a low-income student with a 1400 test score. And even just to start with, in some sense, the dog that didn’t bark here, you might have thought that students with a 1400 from low-income families, they might even be more impressive that they got to that level despite facing all of these barriers, but we see that admissions rates are in fact much higher for high-income students. And we trace that back to three factors. The first and most important factor up 40% of what’s going on is the preference for legacy students. Those are students who are children of alumni of the institution. Now, legacy students affect the admissions rate of high-income individuals for two reasons. One is pretty obvious, the alumni of these institutions themselves are just much more likely to be high income. That’s kind of the generation before, we’re getting the same positive effect of attendance. But the second reason, I think, was a little bit more surprising to me. It turns out that legacy students from high-income families receive a substantially larger admissions boost, even then, legacies from lower-income families. So there’s kind of a preference for high-income students, even within the legacy pool. And you put those two things together, and that accounts for about 40% of the admissions difference. The second factor is the fact that all of these schools designate about somewhere between 12 and 15% of their class for athletic recruits. Now, there’s nothing inherent in athletics, that means that it has to be students from high-income families. And in fact, if you look at the distribution of athletic recruits at public universities, those students mirror the income distribution of most of the other students at the school, in the sense that there’s not a tilt towards high-income families. But at private institutions, the share of admitted students that are athletic recruits among high-income families is significantly higher… more like 13-14%… than It is among admitted students from low-income families where only 5 or 6% of those students are athletes. Now, why is this the case? I was an athlete in college myself, and I don’t think that it’s just because kids from higher-income families are more athletically talented. I think it has to do first with the resources that are available to these kids. Becoming a college baseball player isn’t just about having good hand-eye coordination, it’s about being able to attend clinics, being part of a travel team, there’s like a lot of stuff that goes along with being able to get to that level. And then I think the second factor is that the set of sports that are offered by many of these institutions go well beyond the canonical football, basketball, baseball, which may be a little bit more broad base, but they also include sports like water polo, or sailing or equestrian. And these are sports where I’m sure that there are examples of athletes from all across the income distribution, but think they tend to skew towards more high-income families. So athletic recruits are the second major chunk. And then the third is what my friend David Leonhardt at the New York Times likes to call private school polish. A lot of what the schools focus on in the admissions process goes beyond just how academically prepared people are, and they really like to see somebody who’s doing interesting things that could be as part of extracurriculars, that could be the way they spend their summer, could be the way that teachers write about the students or the guidance counselors write about the students. And all of this gets channeled through a student’s evaluation on non-academic factors. And what we see there is that not only are students from high-income families much more likely to get very strong non-academic ratings, that seems to flow through through things like recommendation letters that are really centered at the school level. And just more generally, you find if you compare high- and low-income students who are attending the same school, you no longer see this disparity in non academic ratings. And so our sense is that these other broader factors that kind of seep into the admissions process are accounting for the third leg of this tripod that’s giving high-income students an advantage in the admissions process.

John K: And some parents are probably sending their students to more elite private schools in the hope that that will enhance their prospects. And the schools that accept them recognize that one of the reasons students are going there is because they prepare them better for selection in a more prestigious institution.

John F: I think that’s exactly right. I think it’s not just parents and schools, the thought that colleges place a substantial weight on these non-academic factors, which then can be kind of trained for and developed over the years, I think this is really a major force that shapes the way that parents and kids and lots of organizations in society direct their resources. So let me just give you an example here. I was presenting this paper at UC Berkeley in the economics department and a friend of mine who lives in San Francisco, who’s a professor there sent me a picture of an advertisement on the side of the road, like kind of billboard on the side of the road, for a fencing academy. It’s called the Saber School. And it says “a safe, fun sport that will help: what are the things that doing saber will help?” Well, number one, it will enhance performance at work and school. Okay, that sounds plausible. Number two, it will enhance speed, coordination, and decisiveness. Number three, it will help you get accepted at top US colleges, just like right there on the billboard. And so if you want to fence as a kid, that’s totally fine, and some people are gonna really enjoy it. But the fact that colleges value this and so now all sorts of people are spending their time fencing simply because they think it will help their college application, I find that to be a little bit silly.

Rebecca: I don’t think we would have found that billboard in my neighborhood. [LAUGHTER]

John K: Although if you brought a saber to work, [LAUGHTER] you might get more attention.

John F: That raises a host of other issues. [LAUGHTER]

Rebecca: In your study, you also examined admission rates at highly selective public colleges. Do their admissions also favor students from high-income households over lowincome households when other student characteristics are held constant?

John F: Yeah, so the public most selective institutions, they provide a really interesting contrast to the private schools, and there are really two differences. The first difference is that it’s still true that students from high-income families with the same test score are more likely to be attending these places like UC Berkeley or Michigan than students from lower-income families. But it’s not the super concentration in the top 1%, the top 1% are about 20% more likely to attend, but so are the top 5% And roughly top 10%. It’s more kind of a broad top of the income distribution than kid of the uber rich that are benefiting from this. Then second, when you do the decomposition that we do at the private schools, you find that, in fact, it’s not the admissions process, the chances of admission for students with a given test score are almost identical across the income distribution, if anything slightly higher for lower-income students. The big differences come in the fraction of students who apply to these schools. You see almost all of the over attendance is explained by higher application rates of high-income students. And so that really points to a very different part of pipeline. And I think there’s a whole other set of issues that in kind of policy concerns that that brings up, just to cite some fantastic work in this space by my colleague at Harvard, Sue Dynarski, she and a number of co-authors have worked with the University of Michigan over the past 10 years, on something called the Hail scholarship. And this program is really focused on this application phase where they reach out to students who are doing very well in Michigan Public Schools, and who are not from high-income families. And they not just inform the students about the University of Michigan, but they provide a simplified form of financial aid, that’s a tiny bit more generous, but just mostly clearer, that’s basically guaranteed zero for four years. And that seems to have really large effects, big increases in the share of students who are applying who receive these types of fliers, that then carries through to those that are admitted and those that end up matriculating. And so, first of all, it’s really interesting that there are sometimes different problems at these different schools. But also, I think it’s a nice lesson that even among two different schools, which are objectively at the very top of the U.S. higher educational sector, there are really important differences in terms of how these different institutions operate, and what types of policies are going to be most appropriate for increasing diversity of students and social mobility at those places.

John K: Is the rate of return to education significantly different between the Ivy plus institutions and elite public institutions?

John F: The answer is yes. But it’s different in a very particular way. So in our data, what we find, using a bunch of different empirical approaches, is that students that attend these Ivy plus institutions are significantly more likely to be at the very top of the income distribution to attend an elite graduate school, to hold a very prestigious job. They’re much more likely to do that than students who attend the very most selective of the public institutions. Those public institutions, in turn, are significantly better at propelling students to these leadership positions than lower rated less selective public institutions. And so it is both true that those public institutions are very good, and also true that these Ivy plus schools are really quite a bit better. That’s focusing on these top end leadership positions. If you look instead at something like what’s the chance that you’ll be in the top 20% of the income distribution, so for kids in their early 30s, that’s earning more than about $60,000. So that’s a good solid, professional job, you don’t have to be a hedge fund manager, there, attending these Ivy plus schools is not really going to make that much of a difference. And the reason is that at that point in the income distribution, that’s just not what the schools are designed for. You’re quite likely to get a job that’s going to pay more than that from an Ivy League school, you’re also quite likely to get a job that pays more from that at one of these elite public institutions. There are differences in average income, but it’s really driven by this kind of a lottery ticket that you’re getting on maybe you’re going to be really just an extreme leader, again, either very top of the income distribution, very prestigious firm. So the answer is yes, these schools differ, but they primarily differ in this particular way, which is why we’ve placed the emphasis on leadership rather than just kind of broad economic security. It’s not clear that students from Ivy plus schools are just broadly more economically secure in that middle of the income distribution than those from public schools.

John K: You also examine in this paper what would be the effects if the admission process at the more elite institutions were similar to that at highly selective public institutions? What do you find there in terms of the income diversity of students in the Ivy plus institutions if those preferences were eliminated?

John F: Yeah. So we’re able to simulate, exactly as you say, what would these classes look like at least probabilistically, if the admissions office were to place less weight on some of these factors, and it makes a meaningful difference. So just to give you one statistic, currently, on average, there are a bit less than 60% of students at these schools that come from the bottom 95% of the income distribution. Those are families making less than call it $250,000 A year. If you were to get rid of all these three preferences that I’ve talked about, if you were to remove preferences for legacy students, just to be clear on what that means, we’re just going to admit them based on all the other characteristics, oftentimes they’re great students, but we’re just not going to give them an extra boost for being a legacy student. If we were to remove this seeming bias that arises in the process where higher-income students are getting stronger non-academic ratings, and if you were to not necessarily remove athletics, but just make the athletes look like all the other students, so there’s not this tilt towards high-income students among athletes, you would increase the share of students from the bottom 95%, from a bit less than 60 up to about 70%, a bit less than 70. And so what does that mean in practice, again, there are about 1600, 1650 students in the average entering first-year class, we’re talking about another 150 to 160 students from more modest backgrounds. And, of course, this is not an enormous change. But it’s on the same order, as people are talking about when we think about what’s the difference in student bodies that might come from changes in racial preferences in admissions flowing from the Supreme Court decision. It’s on a similar magnitude. We’re gonna have 100, maybe 150, fewer students of color on campus. And I think it not only affects the diversity on campus, I think it also meaningfully affects the role that these schools are playing in upward mobility, particularly to these leadership positions. You make some admittedly heroic assumptions and kind of flow things through, this type of change is going to make another two or three US senators from the middle class instead of from very high-income backgrounds. And let’s not overstate this, like it’s only two or three senators, but for a set of decisions that literally 12 People can decide to make if they want to. I think that’s pretty impressive. And that doesn’t even think about well, what if the Northwesterns and the NYUs of the world decided to make some of these changes as well. So my sense is that we’re not going to remake society by doing this, but it’s a pretty low-hanging fruit. And the thing to say is it just from a policy perspective, you can achieve the same differences in the admissions pool, either by getting rid of the preferences that are afforded to high-income students, or by introducing new preferences that benefit students from low- and middle-income families that are particularly academically strong. And what we show in the paper, we kind of calibrated, we say like, if you were to introduce a new preference, specifically designed to get exactly the same mix of students that you would get from eliminating these preferences, what you would need is a preference for low- and middle-income students that’s is weaker than the preference even that current admissions offices put in place for legacy students. So legacy students, on average, are about three or four times more likely to be admitted, you’d need really strong academic students from low- and middle-income backgrounds to be, on average, about twice as likely to be admitted. And that would be a big change. But it’s not like these are changes that go well beyond the type of preferences that are already in place in the admissions process,

Rebecca: …and seemingly pretty actionable. [LAUGHTER]

John F: Yeah, and look, I think that this is a particular moment of fluidity in higher education admissions. Because of the Supreme Court decision, people are not just reconsidering how to think about diversity. That’s kind of the direct effect. But once you open up the gearbox, I think it then becomes natural to rethink a lot of different things when it comes to admissions, both because once there’s a process, it’s easier to think about other stuff. And also because I think that having a preference for students from overwhelmingly high-income families becomes increasingly awkward when you’re no longer allowed to give preferences for students who are clearly experiencing very large disparities in the run up to college. So I think almost all colleges are really strongly considering a bunch of this stuff. Some of them are doing so in publicly announced committees. Here at Brown University, I serve on a committee, including both faculty and trustees that are thinking about a bunch of these issues. Other universities are doing it more internally, only trustees, maybe it includes students. All the universities are doing this in a different set of ways. And I wouldn’t be surprised if we see more change in the way college admissions works over the next year or two than we’ve seen in a long time. And so yeah, hard to know what will happen, but these are an incredibly important set of issues to consider and I hope we’ve been able to contribute to that debate. As an academic, all you can ask for is that people will listen, policies, it’s up to them. There’s a lot of factors that go into that go beyond the research. But we’ve been really, both in public and had a lot of conversations with university leaders about how to think about these issues. So whatever the decision is, I’m confident it will be made on the basis of what I hope is a better set of analyses and understanding for what’s going on than we had before.

John K: Before, I think everyone expected that these types of results were occurring, but I don’t think it was really clear how large the magnitude was. And your study certainly contributes to that knowledge. Having data like this, and these results, I think, will put more pressure on institutions to change than just the general suspicion that they were privileging a very elite group of students. One of the things you note in the study is that making these changes will lead to a more diverse leadership pool, but it may not have as much of an effect on intergenerational income mobility. Could you talk a little bit about that?

John F: That’s exactly right. And I think that stems from some of the themes we’ve been talking about, where the role that these schools play in intergenerational mobility to leadership positions, that’s potentially very large. But they’re just too small to play a role in addressing some of the very broad differences in equality of opportunity that we see in this country, other than through kind of the indirect channel, which is that I think when you have individuals in these leadership positions that come from a broader range of backgrounds, you’re more likely to get policy that’s made in a way that takes into account some of these effects. And so that actually leads to some of the research that we’re really now focusing on, which is that, when you think about intergenerational mobility and higher education, an initial paper that I wrote on this, decomposed the problem into what we called access, that’s who’s attending and the success, what happens to the students that attend, you need both of them to be working together to have intergenerational mobility. If either of them is absent, then you have less mobility. And what we found was that different types of institutions seem to have problems in different areas. So institutions that were highly selective, not only the Ivy plus institutions, but honestly also some of the public institutions in the country, their lack of effect on mobility, in large part, was coming from the relatively un-diverse set of students on an income dimension that were attending their school. Many of these schools, again, both public and private, the share of students come from the bottom 20% of the income distribution is really just 3 or 4%. Really not large at all. So we really wanted to separate the question for these institutions of how do you improve mobility through increasing access with the situation for what is a very different set of institutions, not just the elite public institutions, but some of the open-access institutions, the community colleges where there, not that access can’t be improved, but I think much more the problem is that, in many cases, students are attending these institutions and not being propelled upwards in the income distribution in the way that we would hope. And so that’s really now what we’re focusing on: How can we first measure, in a very broad way, what these different institutions and programs are doing in order to propel students up the income ladder, to really give them the skills, the human capital, the social capital, in order to get good paying jobs and move upwards after that in their career? And then what are the policy levers that you would pull in order to improve that? The way I like to think about this is suppose that you gave the governor of California $10 billion to improve upward mobility in education in his state. Would you want to get more people going to Cal State instead of the California Community Colleges? Is it important that you not only go to all Cal State, is it important that you go to a particular Cal State? Is it important that you have a particular program? Are some programs much more effective than others? Should we be encouraging more people to go to community colleges, even if that costs and has fewer people going to Cal State? Do we want more people to start at community colleges and transfer up to Cal State? Do we want more people to not start at community colleges, because it’s better if you start directly at Cal State? There’s all these different questions. And there’s been some great research on different aspects of it, but I think with the data that we have, we’re hoping to provide a more unifying framework to think about what are the particular places where there’s more or less success for students, again, defined as like the causal effect of attending these places. And how can we expose more students to high success environments, either by moving them around or by changing what the programs are?

John K: In your intro, we mentioned that you were a member of the U.S. Treasury Council on Racial Equity, and the Co-Director of Opportunity Insights. Could you talk a little bit about what these organizations do?

John F: So Opportunity Insights is a research and policy organization that I run jointly with my co-authors Nathan Hendren and Raj Chetty. And what we’re doing there is trying to put together a research agenda to understand upward mobility, both from an academic and a policy perspective. Research that involves this kind of big data has evolved over the last decades to almost look more like a science lab where it’s very team oriented. It’s not a professor and her keyboard or chalkboard just kind of plugging away in isolation anymore. And Opportunity Insights is a way for us to organize all of that team in terms of there are other faculty that we collaborate with, there are graduate students we collaborate with, there are research assistants we collaborate with, there are visitors at all different levels that we collaborate with. And so Opportunity Insights is really the organization through which we just do a lot of this research and try to translate it to help policymakers and whatever that means, depending on the research. The Treasury Advisory Council on Racial Equity is very, very different. Treasury is one of the largest agencies in the federal government. And it has many different policies that directly or indirectly affect racial equity in ways that are obvious or not obvious. And the purpose of this Advisory Council is to bring together people from many different aspects of society that are relevant to Treasury’s financial policymaking. So there are a couple of academics on the committee like me, but there are also people who run financial institutions, there are people who run nonprofits that deal with financial institutions, people who run non-financial institutions, more businesses. And the idea is to be a group that can both proactively offer suggestions to Treasury in terms of how they can change things either out of blue sky or on particular policies that are undergoing after policymaking, as well as a resource for them to turn to when they say look like we’re trying to figure out… an example is a lot of the focus of Treasury over the last two years has been the implementation of the IRA bill, which includes a lot of tax incentives for green investment. How can they implement all of those tax credits? How can they write all those regulations in a way that really does so to support racial equity, and to make sure that black and Hispanic and native individuals are not left behind in a way that, unfortunately, has been too often the case in our nation’s history. So that’s far from a full-time role. We meet once a quarter in public meetings and try to offer our suggestions. And even again, this suggestions span how Treasury should implement different regulations from even how Treasury can make research on racial equity more accessible, or make data more accessible to support more research so that there’s more broad knowledge when it comes time for policymaking.

Rebecca: You’re doing some really exciting and interesting things.

John F: Thank you.

Rebecca: Thanks so much for your work and sharing it with us today. But we always wrap up by asking: “What’s next?”

John F: So I talked about some of the work in the college space. But I’m trying to think about other parts of upward mobility as well, to understand how environments or policies contribute to these disparities or what policies can help alleviate them. And a big theme in some of my recent work is to try to broaden our measure of mobility to go beyond these purely economic measures. It’s a natural place to start, both because having a higher income is something that is kind of meaningfully related to the quality of one’s life and also because it’s pretty consistent data to measure income. But I think even economists will admit to you that income is not the end of it. And we’re trying to think about other ways, not only to measure people’s wellbeing thinking about health, thinking about social capital, for instance, but also to measure or folks influence on broader society. So there are positions like entrepreneurs or scientists, inventors, that if we generate more innovation in society, that’s not something that just benefits the individual inventor, it’s something that benefits society much more broadly. And so I think that’s not only very important as kind of an alternative economic outcome, but it’s important to thinking about why something like social mobility goes beyond merely thinking about well, each individual should have their fair chance of success. These are ways in which just society as a whole is better, more innovative, more engaged, when there’s more upward mobility. And in that way, I think it’s really a rising tide that can lift all boats. So that’s a little bit of what I’ve been thinking about recently.

John K: Well, thank you for taking the time to join us. We really enjoyed this conversation. And we really, as Rebecca said, appreciate all the work that you’ve been doing.

John F: Thank you so much. It’s really been a pleasure to talk with you about all this work over the last hour and I appreciate that.

[MUSIC]

John K: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

327. Attacks on Education

In the last few years, a growing number of state and local governments have attempted to limit diversity, equity, and inclusion initiatives and to place restrictions on what students are allowed to learn. In this episode, Kevin Gannon and Cyndi Kernahan join us to discuss strategies that can be used to resist these attacks on education.

Kevin is a history professor and the Director of the Center for the Advancement of Faculty Excellence at Queen’s University of Charlotte. He is the author of Radical Hope: a Teaching Manifesto, which is available from West Virginia University Press. Kevin also appeared in 13th, the Netflix documentary on the 13th amendment. Cyndi is a Psychology Professor and the Director of the Center for Excellence in Teaching and Learning at the University of Wisconsin at River Falls. She is also the author of Teaching about Race and Racism in the College Classroom: Notes from a White Professor.

Show Notes

Transcript

John: In the last few years, a growing number of state and local governments have attempted to limit diversity, equity, and inclusion initiatives and to place restrictions on what students are allowed to learn. In this episode, we discuss strategies that can be used to resist these attacks on education.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Kevin Gannon and Cyndi Kernahan. Kevin is a history professor and the Director of the Center for the Advancement of Faculty Excellence at Queen’s University of Charlotte. He is the author of Radical Hope: a Teaching Manifesto, which is available from West Virginia University Press. Kevin also appeared in 13th, the Netflix documentary on the 13th amendment. Cyndi is a Psychology Professor and the Director of the Center for Excellence in Teaching and Learning at the University of Wisconsin at River Falls. She is also the author of Teaching about Race and Racism in the College Classroom: Notes from a White Professor. Welcome back, Kevin and Cindy.

Cyndi: Thank you.

Kevin: Thanks. Great to be here.

John: Today’s teas are:… Kevin, are you drinking tea?

Kevin: I am not drinking tea, I have moved on to cold carbonated bubbles. And I’ve got a big vat of Diet Pepsi. [LAUGHTER]

Cyndi: I love the word vat. [LAUGHTER]

John: …and Cyndi?

Cyndi: British Breakfast.

Rebecca: Perfect. I have blue sapphire today.

John: And I have some Christmas tea, left over from a reception we had in the teaching center here about a week or so ago.

Kevin: Isn’t it cold by now? [LAUGHTER]

John: It is freshly made today, but we had a lot of leftover tea from there… with a cinnamon stick sitting in it.

Kevin: Ah, very festive.

Cyndi: Fancy, yeah.

John: We’ve invited you here today to discuss the restrictions that some state legislatures have been imposing, or attempting to impose, recently on what can be discussed in college campuses. Many of these restrictions seem to be focused on imposing alternative versions of history and on banning discussions of diversity, equity, and inclusion issues. Before we discuss these, though, is this something that’s entirely new, or have we seen this at some points in the past as well, with state intervention in academic freedom and issues of what students should be allowed to learn?

Kevin: I think this has some resonances with what we’ve seen in the past. And in particular, I’m thinking of the sort of anti-PC hysteria that emerged from so-called conservative thought circles in the 1990s. And so there’s the big curriculum debate over the National History standards that occurs in the early 90s. But what we’re seeing now with the mobilization of actual state power, I think, is an important difference of degree even if it does resemble some of the same sorts of rhetorical devices and button pushing that we might have seen in the past.

Cyndi: Yeah, the 1990s are what also popped into my mind, and it seems like attacks on higher education and on education generally, they come around in different ways, and for different reasons, it’s always an institution that is under attack.

Rebecca: So critical race theory has been the focus of many attempts to limit academic discussions of this topic. Can we start first by maybe defining what that is?

Kevin: What it is or what it has been made out to be?

Rebecca: How ‘bout both?

Kevin: I’ll actually take the second part of that first. What it’s been made out to be, is the sort of malleable boogeyman concept in the hands of pretty cynical right-wing actors, like Chris Ruffo, from the Manhattan Institute, for example, is probably the most prominent of these, who have basically admitted that this has become a stand-in for all of the things that are, quote unquote, wrong with higher education. It’s a concept that in its true sort of accurate provenance comes out of the critical legal studies movement. Critical race theory starts in law schools, and moves into areas like education, and then other areas of the humanities and social sciences to talk about how what we see as racism and, in particular, racist outcomes are not the product of individual bad actors so much as they are systemic features. It’s a counterpoint to the sort of feel-good narrative of civil rights, where people might say, “Oh, things were bad, and then Martin Luther King came along and segregation ended and then now everything’s great” and critical race theory says: “Not so fast, my friends, we need to talk about structures and systems.” And because it comes out of a discipline, Legal Studies, and is a largely academic conversation in many ways, it becomes easy to paint it with this brush of critical race theory is communism, critical race theory is reverse racism, critical race theory is anti white, because it’s such an unfamiliar concept to the general reading public that it becomes a blank slate for bad actors like Ruffo and others to inscribe whatever they wish on it.

Cyndi: I think, too, it’s important to keep in mind that that word system is a word that I think about a lot because I do think that there is a divide and a difference there around the folks who really don’t want to accept the idea that racism, along with other isms, is a systemic problem. And so I do think that, in that way, it’s really interesting to watch. One of the things that really caught my attention… I’m sure you all probably are familiar with the AP African-American Studies controversy in Florida, whether or not Floridian students would be allowed to take AP African-American Studies. As I was sort of watching, and it’s continuing with the evolution of that course, as the AP sort of responded to criticism, one of the things they did… I think they’ve since reversed this… is they took the word systemic out of the course, there was a report in The Washington Post about that and I thought, that’s really interesting, because that really is a divide where you see on the right folks saying, “we don’t want to think about this or talk about this, this is not a systemic problem;” whereas that’s not the scholarly understanding. And so that, to me, has become a really telling default line. I saw it echoed across the executive order in Oklahoma that was just handed down, I think, last week or a couple of days ago. And it was very interesting, the language around, “we want to guarantee access, but not equal outcomes” is an interesting phrasing that, to me, again, signified there’s an unwillingness to think about it as a systemic thing, which is where a lot of the fight of this becomes, and Kevin’s absolutely correct, that it does become this huge catch all. And even Ruffo himself says that in the interviews I’ve read, when they think of anything sort of bad in higher ed or education, it’s going to be critical race theory.

John: One thing that’s really struck me about this is how extensive it is, reaching from the federal level to stage to even local K through 12 school districts. We even saw some board candidates locally, who were part of one of these groups trying to restrict what students are allowed to learn. How extensive is this problem?

Kevin: Very. The Chronicle of Higher Education, for example, has a DEI legislation tracker that I urge anybody listening to this to consult regularly, because it is a fairly quick moving landscape. And I think one of the dangers for those of us in higher ed is, if you live in a state, so called blue states, you can say, “Oh, well, this is a Florida problem or a Texas problem or a North Carolina problem. But it’s not. It’s a national problem. There are states that are further down that path. But this is not something that’s just going to stay over there. And because it is a movement that is national in scope, it’s funded nationally, it is heavily bankrolled, they’re using the same sort of legislative and PR templates. Those measures have been successful quicker in some places. But wherever they’re being used, they have been successful to a degree. And so I think that’s the thing to keep in mind here is that this isn’t just some sort of localized phenomenon. It is a truly nationally oriented thing that we’re wrestling with. And I think that not seeing that is to really put yourself in danger iIf you care about the fundamental values of what we’re supposed to be doing in higher ed.

Cyndi: I want to add another resource too to the Chronicle one that I like, I think, even better. It’s the CRT Forward Project from UCLA. They have a map. I like their map a lot, because you can filter between higher ed and K -12, local versus state level. My read of that most recently is that there are 10 states that have passed legislation and at the higher ed level that is restrictive around what we teach and what we can do. And then there are lots of other states that have things in the works. So it just gives you a sense of what Kevin’s saying of just how extensive this is. And I would argue further, I would add, I think another way I’ve started to really think about this, just based on what I’m reading, what I’m seeing in my own experience, is that this is so connected to the politics of austerity. And I think we don’t think about, that we don’t connect it. But a lot of the reason why these problems are cropping up, it’s also tied to the lack of funding for higher education, which makes it more difficult in multiple ways. But it weakens us politically, it weakens what we can do in the classroom. I won’t go into but there’s a whole bunch of analyses that really connect the adjunctification of our campuses to these attacks on DEI, to the cutting of DEI positions. There really are a lot of connections there that I think you’ll recognize. And that way, it makes it even more extensive, because I would argue it’s not just the laws, it’s also that cutting our funding and not allowing us to do the work that we need to do. I think it’s connected to all of this as well. It feels like a very bought this attack on higher education and education generally.

Kevin: Yerah, yhat’s a crucial point. Look at what’s happened recently in Wisconsin, where the state boards… I don’t need to tell Cyndi about any of this, because that’s her system… but, there’s a surrender in advance to the Republican-controlled state legislature sort of diktats against DEI work. You don’t need to pass laws that abolish DEI if you make funding contingent on presidents and individual institutions doing that for you. And those things work because austerity and the sort of neoliberal approach to higher ed has created an extremely resource scarce environment where those who shepherd institutions are predisposed to sort of comply in advance, as scholars of fascism warned us not to do. And if you look at the history of the austerity movement in higher education, one of the real touch points of this process is when Reagan becomes governor of California, and Reagan and the California Republicans stick it to the University of California system as a sort of revenge for the upheavals, in particular Berkeley in the 1960s. And so a state that offered free tuition for California residents, to this sort of crown jewel university system, Reagan gets rid of it, the Republicans in California get rid of that. And that becomes a blueprint for this process that Cindy’s just talked about. We’ve seen that go national, and it’s only taken a few short decades to accomplish.

Cyndi: Yeah, one last point on that, too, that your comments made me think of, Kevin, there was a paper in economics several years ago that showed that the states that have diversified the most, if they have Republican controlled legislatures, the funding in those states goes down, and it’s connected to the diversity of the institutions. So, that’s another way in which we see this connection between austerity and diversity and politics. That’s really troubling and challenging to work with. I feel like we don’t connect these things enough, but we really do need to.

Kevin: Yeah, it is no coincidence that as the proportion of faculty and students of color have increased in higher education, that funding has decreased in almost direct variation, and that is absolutely intentional.

Rebecca: So, you both talked about many contributing factors to the growth. Can you talk a little bit about why it’s happened so quickly? And maybe, [LAUGHTER] how do we make it slow down? [LAUGHTER]

Kevin: Well, higher ed doesn’t exist in a vacuum. And we’re in the middle of an authoritarian turn, to say the least, in both international and national politics. So you have a globally connected right-wing movement. And if you look at the way that fascist and authoritarian movements have developed with the late 19th, and early 20th century, higher education and the sort of intellectual landscape are fields of play for these movements to establish power. Practitioners and students in higher education have made convenient boogie men for those who aspire to building support for authoritarianism and fascism. And so what we’re seeing, I think, is this process has accelerated so much so intensely in recent years, because we have a fascist movement in this country, and it has accelerated so much and so intently in the past few years.

Cyndi: I think there are phases where we can see effective ways to push back against this. I really do. There’s not enough of them. But there are ways to get to the second part of Rebecca’s question around like, “What do we do?” I think we have no choice but to act collectively and to work to push back together. I mean, that’s why Kevin’s point about this isn’t a Florida and Texas thing. It’s not. like I said, 10 states from my count, when I was at that CRT tracking math, and it’s on a lot of other places, and through lots of actions. So the collective action that’s inspiring to me… I think a lot about the state of Ohio… they had a bill that was quite restrictive, it would have restricted what could be discussed in general education, very similar to Florida. It had a lot of restrictions around what can be taught. And there was a strong movement against it. And what was crucial, in my reading of that, was not that it was just faculty and students pushing back, which they did, there were protests. But, more importantly, there was no compliance in advance, as Kevin mentioned a minute ago. So the regents or the board, I forget what they call it in Ohio, but those presidents of those institutions, they banded together, and they sent a letter pushing back against that. And it was the university leadership, faculty, and staff and students all pushing together against that. And that bill’s effectively dead now. It did pass the Senate, but it did not pass their assembly or else it did not become law. And this year, it has not been taken back up. There was just a word on that recently. That to me is very inspiring. That tells me that you don’t have to do this, we can push back in states that have systems. Those Chancellors, those Presidents can stand together against this. They do not have to comply in advance. They don’t have to argue with folks who don’t believe in what we do. I think that we can do that by getting everybody on board with that challenge.

Kevin: And Cyndi’s point here is essential, that institutional leadership has a really crucial role to play here. And this is where we’re seeing what I would term as a failure in so much of the leadership across higher education. You know, we’ve been told for decades that the increasing salaries of upper level administrators are because we’re bringing in bold, innovative leaders who aren’t afraid to make tough choices and hard decisions. And yet we’re seeing a vast silence from most of them as this last several years has unfolded. It’s not like the leaders of Ohio State institutions are like a Marxist collective. These are university presidents. [LAUGHTER] These are not wild-eyed radicals, but they led and the results were tangible. So if you look at things like Florida or Texas, one legal test case, pushing back against these curricular mandates as a violation of speech rights, for example. What would be the result of that? What message would that said to one’s own faculty, staff, and students? But we haven’t seen that we saw the community colleges in Florida, the presidents of those institutions issue a sort of collective statement, at least most of them, where they basically said, “Okay, fine, we’ll do all these things…” again, get this sort of comply in advance, and what message does that send to the people at your institution, because clearly, what you’ve done is you’ve abandoned your mission. That mission statement on your website needs absolutely nothing if you’re not willing to defend it against strong political headwinds. And so the main obstacle to this collective action is a leadership vacuum brought about by either moral cowardice or by leaders who actually agree with what’s happening and are willing to let these things happen to their institution because they personally sympathize with them. I don’t know which one of those is worse.

Cyndi: I think, too, there’s a little bit of an assumption that while it won’t be that bad, it can’t be that bad. They won’t really do that. And we’ve seen that a lot, too, I think. And that also is a fundamental mystery.

Kevin: It will be that bad. I’m a historian, and I can give you a reasonably expert opinion that it will indeed, if you let it get that bad.

John: Could some of this be caused by perhaps the fact that we tend to see people who have more education tend to be more liberal and perhaps might be less likely to vote for Republican candidates?

Kevin: I think there is that partisan element to it. I think that’s at the root somewhat of why this trope as universities of hotbeds of leftist radicalism is so effective, which again, takes one small slice of the intellectual and political climate at a particular institution of higher education and reads it across the entire sector, as if engineering and economics departments and business schools don’t exist. But I think that partisan element, this perception that well, here are the places where all the people who vote for Democrats live and work, is an effective one. But it’s also again, if you look at who’s wielding power and making decisions at universities, these are not hotbeds of leftism, by any means. And it’s just remarkable how successful that trope has become. It’s also, I think, an effective trope because we, and higher education, ourselves… back to Cyndi’s point about the necessity of solidarity and collective action… we have not been able to tell our story as effectively as we might. I’m not intending to get into blame the victim discourse here, but I do think that there are ways that we can advocate for ourselves and what we’re doing that have been more effective than what has usually been the case.

Cyndi: Yeah, I would agree. I think related to that point, it reminds me actually, of something you talked about in Radical Hope, Kevin, around the idea of sort of accepting this framing of what we do is we’re just only about workforce development, and we’re only about developing these sort of skills. And that’s not all of what we do. And we need to be able to talk more broadly about what we do and why it matters, and why it matters for everyone.

Kevin: Yeah, one example of this disconnect, if you look at all the surveys of prospective employers, and they say, “What are the skills that you’re looking for, for college graduates that you would want to hire into your company or your firm?” They all talk about things like critical thinking, ability to work in diverse teams, understanding people with viewpoints and backgrounds who are different than your own. This is the business community basically saying here are the things that are important. While you have right-wing politicians on the other side of the coin, saying these are the very things that we want to outlaw [LAUGHTER] in higher ed. And so I think it testifies to the power of this narrative that higher education is a hotbed of sedition, when, in actuality, most of what is in the crosshairs of these legislative and political efforts are actually things that are, on the broad face of it, not controversial, and generally agreed upon by almost all of society as good things to have.

Rebecca: I think to make collective action work effectively, folks need to be somewhat on the same page. And so if people are supporters of diversity, equity, and inclusion, but aren’t aware of counter arguments against that, it might be hard to take action. Can you talk a little bit about why folks are so opposed to these efforts?

Cyndi: My read of part of it goes back to that idea of racism as a systematic problem. There’s a lot of research on K-12 education around race that shows that, particularly for white Americans, but really across races as well, you see it as sort of a fundamental misunderstanding of what racism is, how it operates, how systemic it actually is. Part of that is because we’re in the United States, which is a very individualistic place and so we tend to think in terms of those problems, even the way often that DEI is framed, it’s very individualistic. And so we don’t think of it as a broader systemic thing. And that keeps us from acting collectively as well, because we’re not really thinking about it in that terms. I see that a lot. That is my main teaching and learning goal, when I teach about racism or other systems of oppression, is just to make that shift, sort of the individual acts of meanness over to this more systemic understanding, and understanding that really the most important things like, I constantly get the question from a lot of my students: “Well, okay, so what do I do about these problems? What should I learn more about?” and then like, “If you can learn more, that’s great. Like, I want you individually to learn as much as you want. But if you really care about this, you have to think about policies and voting, and what broader policies are being enacted.” And I try to give them examples just to help them start to think more broadly about these things. And I think that disconnect is part of it. Because if you believe that it’s just individualistic, it’s just about being a good, colorblind person, which is also often tied into one’s morality, like “I’m a good person, so that’s all I need to do. I don’t necessarily need to think beyond that.” And so then it makes sense if you are told over and over again, that there are these DEIi administrators trying to force you to have particular thoughts. It kind of makes sense from that perspective that you would want those thoughts, and that you would think they were going too far on the college campuses. But if you understand instead, that it’s not about color blindness, and it is this broader systemic thing and there are broader problems of not just access but opportunity and outcome, then that changes. But until people start to understand those broader things, I think it’s always going to be a struggle.

Kevin: Yeah, I think Cyndi’s point about us living in this overwhelmingly individualist sort of society and culture is a key foundation, a key part of the answer here, because one of the things that surprises me a little bit is that arguments like the one that Heather McGee makes in her book, The Sum of Us, that those haven’t gotten more traction, where she talks about the famous anecdote she uses is during desegregation, states in the South would close their swimming pools rather than integrate them. And what happens is, all these communities now don’t have a swimming pool at all. And so part of that is to the white folks of that community, rather than the swimming pool complexes racially integrated they went without. Is that really a good outcome? Taking the moral element out of it, it’s like, here’s a public good that is no longer available for the public. And so what racism does, McGee argues, is it hurts everybody to varying degrees and in different ways, but it’s actually something that is poisonous to the very roots of any sort of people that would claim to live in community or society with one another. And I remain discouraged that that argument has not gotten more traction, because I think we need to appeal beyond this sort of sense of individualism. Like Cyndi said, like, “Well, I’m a good person, so racism doesn’t exist. These other racists are bad, but we can quote unquote, educate our way out of it, or a magical black person like Martin Luther King, Jr. will come and absolve everyone from their sins,” right? And of course, that’s not how it works. But this tide of individualism, this conditioning that we have, is so powerful that it makes systemic critiques into a sort of existential threat for folks who are not ready to make that journey, because it becomes a threat to an individual to say, if you live in a system that is fundamentally racist and inequitable, for example, if you subscribe to this sort of inherent individualism as the core of your identity, that a systemic critique says, “You live in this system, and it’s your fault, at least partially that the system is like this.” And if you can’t separate those two out, and if you can’t make those distinctions, you’re not going to have a very useful conversation about what we would term as DEI. And instead, what you get is you get anecdotes of, let’s say, unskillful students making an argument in some inelegant way that is an easy thing to lift out of context and present as here’s what DEI is, these lefty kids running amok protesting food in the dining hall at Oberlin, for example, and turning it into a kind of theater of the absurd. And so we’re swimming against such a powerful cultural tide when we try to do this work because it is asking people at least to set aside this fundamentally individual centered ethos. And that is a really heavy lift for all of us, I think.

Cyndi: Although I have some good news, if you guys want to hear it.

Rebecca: I’ll take it, I’ll take it. [LAUGHTER]

Kevin: I would love to hear good news.

Cyndi: This just comes from my own individual teaching experience, because what Kevin’s talking about is a powerful argument, the sort of Heather McGee’s and there are others too. And what I’ve started doing, and I’ve found that post-2020 It’s become a little bit easier for this to get purchase in terms of teaching. I really do think that there is a lot of hope in our teaching. One of the ways that I’ve started to help my students cross that bridge, that divide from the individualistic to systemic is to have think in terms of their own lives. And one of the most clear examples to go all the way back to like sort of where we started, it’s like they pay more for college tuition as a result, I would argue, of racism, and sometimes some forms classism, too. And there are several ways to get at this. Heather McGee, in that great book, The Sum of Us, that Kevin mentioned a minute ago, she has a whole chapter on college funding and how it’s gone down. I mentioned the economics research that shows that. So these austerity policies that are related to diversity and racism and fear, frankly, cost a lot of white students, particularly students that I work with, tend to be first generation, a little bit lower income, and I know you all do too, as well, at your institutions. Public regional institutions, and not private, we serve a lot of students who are directly affected by these austerity policies, they’re directly connected to race. So again, I mentioned Heatherr McGee. I also have another great resource that I’ve been reading, it was written by a couple of sociologists about the racial consequences of underfunding public universities, they look at two schools in the California system. You don’t have to give all of these to students. But it turns out that it’s very easy when you work with students to sort of talk about, let’s think about what systemic racism means. Here’s a way it impacts you directly. My classes are overwhelmingly white, but speaking with white students about that, and helping them connect those dots, they can do it. And part of what I think has helped us, that’s a strange way to say it, but post-2020, is that after 2020, people started using the word systemic racism a lot more like in social media. So I have more students that will come into my courses, saying that word, I don’t think they fully appreciate what it means. But it’s more of an opening. And so then we can start to think about all those ways in which it is harmful to everyone. Racism is harmful to everyone, it costs all of us more than it should in lots of ways. And not just in terms of like sort of the moralistic framing that we often use, but real material differences. So that’s one way that I found hope, I guess, it’s to go back and to think about how to teach about these issues in a way that feels good. And I think there’s a lot of things instructors can do, no matter what they teach, to sort of start to get out these issues and help students to think about it.

John: I’ve seen some similar things. And one thing I’ve noticed is that as our classrooms become more diversified, as we have more first-gen students, as we have more students from historically minoritized groups, we’re seeing people in general becoming much more aware of some of these issues. But one of the challenges, as you both have mentioned, is the issue of austerity that colleges have moved to a more contingent labor force, there’s a larger proportion of adjuncts. And while it’s important to be able to push back, many of the people doing the labor of classroom instruction are in a position where their jobs are very much at risk. And if their administration is not going to be supportive of DEI efforts, they face losing their very limited incomes that they’re receiving from these positions. Is there anything we can do to address that challenge?

Kevin: Again, I think part of the answer to this goes back to the idea of leadership of institutions. What is the mission of your university or college? What are you saying that you’re going to be doing? Why are you there? Our mission statements as institutions are promises that we make to all of the stakeholders of that community, whether they currently are part of the community or external groups in the town in which we’re situated in the area, for example, potential students and their families, we don’t put Terms and Conditions on our mission statements, we say that X University will provide a powerful educational transformative experience to all of our students. We don’t say all of our students who meet a certain income level or all of our students who come from certain demographic groups. We mean all of our students. And so if we’re going to do this mission driven work, and we’ve got study after study after study that talks about having a diverse student body and a diverse faculty and staff, not just racially and ethnically, but diversity and all of the ways that matter lead to better learning outcomes. In other words, we do this education thing better when we do it in diverse places with diverse people. And if that’s what you want, which I would argue we do, then that’s what we need to lean into. And so if you’ve got folks who are doing that work, who are not supportive, who are contingent and precarious faculty and feel that they cannot do what is, I would argue, inherently mission aligned work, that as an institution, that is a problem. And you need to do something about that. And so if you’re a department chair, how are you supporting your part-time colleagues? If you’re a professor with tenure, how are you supporting your part-time colleagues or your junior colleagues who aren’t tenured yet? How are you providing cover? How are you modeling things as a secure person in a secure position? How are you advocating in governance? How are you advocating in Provost’s Council or a senior leadership’s cabinet? How are you looking at getting rid of just semester-based contracts and moving towards annual- or several-year contracts? You can’t wipe out precarity at a single swoop. But what you can do is fix some of the sharpest edges of it, to blunt those. That’s the work in front of us in the short term. And if you’re not supporting your colleagues doing that, that none of this works… Again back to Cyndi’s central point, we either do this collectively or we don’t do it at all.

Cyndi: Yeah, I think anybody with any power in any sort of safety, and I use safety in quotes, but like anybody who can has to push back, and this pops up in really small places that you might not recognize. I was reading too about the southern accreditor, I forget what their official thing is. But you know, they’re talking about changing the accreditation, that is absolutely compliance in advance. That is the wrong way to go. Our accreditors, that’s part of what worked in Ohio, where the arguments about it were going to be out of compliance with accreditation. If the accreditors are complying in advance, and watering all this stuff down and not sticking to the mission, that’s a problem. So there are a lot of people who have a lot of power and the ability to push against this, but you have to push against it. All of us do, in all those spaces that Kevin just mentioned, because reducing the harm and softening those edges as much as we can, it’s our responsibility to do that, particularly for people who are adjuncts and semester-to-semester contracts, because that precarity is real, and it is a problem. And I’m sure you’ve all seen it, I have seen it too. And we can work with our students, because our students will work with us. They believe in these things. The ideas we have about students are so often wrong in terms of that. So working with our students and not believing in caricatures about students.

Kevin: Yeah, that’s an essential point, Cyndi, and thank you for raising that, because I think one of the things that we haven’t touched on here, but is a vital thing to bear in mind, is that these legislative efforts are profoundly anti-student. They’re not just anti-higher education, they are profoundly anti-student, anti-young person. They make the assumption that learning only happens through indoctrination. They are based on the premise that students will learn only what is sort of rammed down their throat, basically, pedagogically. They make the assumption that students cannot handle certain truths. They make the assumption that some things just aren’t worth knowing, and they take that decision process out of the students’ hands. They are profoundly anti-student. Among all of the other things they are, this is the essential truth at its core, that these laws, this legislative effort, this broader cultural political campaign is based on a profound contempt for students, for young people, and by extension their families. And so we need to understand that our students want the same thing for them that we want for our institutions. And if we’re able to see our students as allies in this and get our students to see themselves as allies in this, nobody wants a crap education. Nobody wants an indoctrination, force-fed prefabricated chunks of content. We know that doesn’t work. And so to engage the student voice in this in a systematic and supportive way, I think, is a really important part of the equation and a great untapped opportunity across our institutions. But that needs to be, I think, one of the ways in which we push back against these efforts is to really call the fact out that y’all just hate kids. Y’all hate learners, you don’t just hate schools and instructors, you hate the people that these institutions are ostensibly trying to serve. You may say that these are pro-children and pro-family, but they’re not. They hold children and students in profound contempt. And we need to hammer and hammer and hammer on that point, because that’s the reality.

Rebecca: Change is only likely to happen when the whole community’s engaged. So you’ve outlined today: administrators, faculty, staff, students, the whole community working together,

Cyndi: We have a lot more power than we do.

Kevin: Yeah. Scholars of fascism and authoritarianism will point out the fact that the one thing that successful movements of this stripe do is they get you to give up your agency and oftentimes without a fight. So that’s why complying in advance, the phrase that we’ve used several times, it’s so dangerous, because we give up our agency, we forget that we have it, and then it becomes much easier for these movements, which are not representative of the majority, not representative of our community or it’s aspirational values, but it allows them to be successful because the great majority of folks have given up agency. And so as long as we not just recognize the agency we have, but deploy it effectively, then, and only then, can we push back successfully.

John: We always end with the question: What’s next?

Cyndi: What’s next is I have a final tomorrow. So that’s probably like what’s most salient in my mind. So, you know, wrapping up this semester, but definitely more seriously, I want to think more about these questions and how to get people collectively to think about these larger points, about just what Kevin was saying about the real paternalism and contempt for students that is evident in the laws, helping students to understand what this is and why it matters for them, figuring out how to write and speak and work with people more to get people to see the power that they have. We don’t have to do this. We don’t. We can keep our education systems and classes free from this interference, and we should.

Kevin: And I think, for me, as someone who works in Educational Development at a private institution. I think that those of us who have a little more latitude, we’re not immune from any of this, but we do have some affordances that public institutions don’t. And so it’s part of my job to help my colleagues and to build a model of what this looks like to do well. What does it look like to do this work in solidarity and community? What does it look like to do meaningful, as opposed to just performative, work along equity and justice oriented teaching and learning, because it’s so much easier to advocate for these things if we could point to concrete examples of what they look like, how they can sustain themselves, and what the benefits are. And so I think as an educational developer, that’s kind of my responsibility, what I feel bound to continue. And I’m fortunate to be in an institution that values those things. And so I need to take advantage of the climate I’m in to advance that work.

Rebecca: Well, thank you so much for joining us and giving us plenty to think about and ways that we can perhaps act by modeling and coaching and working to have collective action.

John: It’s always great talking to you. Thank you again for joining us, and we’re looking forward to more conversations in the future.

Kevin: Thank you for having us.

Cyndi: Yeah, thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]