344. Failing Our Future

The traditional grading system that we are all used to is of relatively recent historical origin. In this episode, Josh Eyler joins us to discuss research on problems associated with traditional grading systems and possible solutions at different scales and in different educational contexts.

Josh is the Director of Faculty Development, the Director of the ThinkForward Quality Enhancement Plan, and a faculty member in the Department of Teacher Education at the University of Mississippi. He is the author of How Humans Learn: The Science and Stories behind Effective Teaching and a forthcoming  book, Failing Our Future: How Grades Harm Students, and What We Can Do About It.

Show Notes

  • Eyler, Joshua R. (2024, forthcoming). Failing Our FutureL: How Grades Harm Students, and What We Can Do about It. John Hopkins University Press (pre-order link)
  • Eyler, J. R. (2018). How humans learn: The science and stories behind effective college teaching. West Virginia University Press.
  • Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., … & Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of educational research, 86(4), 803-848.

Transcript

John: The traditional grading system that we are all used to is of relatively recent historical origin. In this episode, we explore research on problems associated with traditional grading systems and possible solutions at different scales and in different educational contexts.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Josh Eyler. Josh is the Director of Faculty Development, the Director of the ThinkForward Quality Enhancement Plan, and a faculty member in the Department of Teacher Education at the University of Mississippi. He is the author of How Humans Learn: The Science and Stories behind Effective Teaching and a forthcoming book, Failing Our Future: How Grades Harm Students, and What We Can Do About It. Welcome back, Josh.

Josh: Thank you. Thank you. Great to be here.

John: We’re happy to talk to you. And it’s been a while. Today’s teas are:… Josh, are you drinking tea with us today?

Josh: Well, you know how I roll, you guys, I don’t have tea, but I have some lovely water. [LAUGHTER]

Rebecca: So tasty. I have a Scottish afternoon today.

John: And I’m trying to cut back on caffeine, so I just have a peppermint tea today.

Rebecca: Well, if you wanted to cut back on caffeine, you could join Josh with water. [LAUGHTER]

Josh: That’s true. [LAUGHTER] Come join the club, John. [LAUGHTER]

John: I suppose that probably would not be an unhealthy thing to do. [LAUGHTER] And I have been drinking a lot more water recently.

Rebecca: So, we invited you here today to discuss Failing our Future. Could you tell us a little bit about how this book project came about?

Josh: Sure. Yes. So it has a couple of origin stories, actually. One is that when I was writing How Humans Learn a few years ago, I was working on the final chapter on failure. And I kept coming across research on grades and grading and the obstacles that they set up to learning. And certainly if you’re thinking about failure as a tool for learning, you immediately are confronted with the fact that in systems that prioritize grades, they push back on the natural cycle of learning, where we try something, we fail, we get feedback, we try it again. Grades are set up in the opposite direction, they arrest that process before it can really play out. And so that is what piqued my interest. And I don’t know that I could say honestly that I thought I was going to write a book about grades at that point. But I knew that it was an important element of what I was discussing. So I’d say a few years after that, I think what we were seeing was a lot of discussion about grades, a lot more experimentation with it. That led me to want to write a book for a broader audience, one that certainly included educators, but one that cut across the K-12, higher ed divide one that was also for parents and policymakers and students, one that really took a bird’s eye view of the larger conversation about grades, trying to pull all of what we know together so that we could move forward as a community to try and enact change. So that’s what got us here. And the process was certainly longer than I expected due to the pandemic, but it was also just a very illuminating process. And I heard some heartbreaking stories as I did interviews for this. But overall, I’m really proud of the work.

John: And you mentioned addressing this through the entire educational spectrum. And I think it’s important to address it through the whole system. Because by the time we see students in college, they’ve already been indoctrinated into a system of grades, and there’s a lot of resistance to change, and also a lot of damage, perhaps, may have been done by the use of grading systems early. Could you talk a little bit about how we ended up with this system of grading, which has been so much a part of the educational culture from kindergarten on up?

Josh: Sure, yeah. And you’re right about the fact that students are conditioned for at least 12 years before they get to us to think about grades as being the most important thing about education. So how did we end up here, we could have a podcast episode that would last five hours if we really wanted to dig into that. But I’ll focus really on the more recent history. And that is that the A through F letter grade scale that we have is really about 125 years old. Our first records of a full letter grading scale come from Mount Holyoke in the 1890s. So they were the first to implement it. Back then it was A through E. They later dropped the E because they were afraid that people would think that they were excellent when they were not, you know, God forbid that we allow people to think that they’re excellent. And so they dropped the E and added a letter where there could be no mistake about what it meant, and that was an F, for failure. So that’s when it began. But that system, the letter grade system, was not formalized, or standardized, really until the 1940s. That is when you see a majority, in fact, of school districts and colleges and universities adopt that system. And what I think is most important about that, actually two things. One is that none of this has ever been inevitable, that the 1940s is less than 100 years ago, so this is not something that was cast in stone at the minute the American educational system began; it has changed and can be changed. The second thing, though, is that all of these schools, districts, all of these colleges adopted that system, not because they thought it was the best way to document student learning, but simply because it was the easiest way to communicate across institutions. They felt that if they had a common system that they could communicate more effectively between themselves. So it was not about student learning. It was not about student progress or growth or development. It was simply about communicating. That’s how we got here. And now we’re trying to figure out where do we go next? How do we undo some of the damage that has happened since that time?

Rebecca: Speaking of damage, do you want to underscore what some of that damage is? [LAUGHTER]

Josh: Sure, and I know that there’s room for reasonable debate about the terms that we use here. But I honestly really do think we can use the framing of damage and harm when it comes to grades. And in the book, I have several categories. The first and most obvious category for that damage has to do with learning, that grades set up obstacles to learning. They inhibit curiosity, they inhibit creativity, they inhibit risk taking, they affect intrinsic motivation. This is painfully obvious, but grades are classic extrinsic motivators, which means that they are very good for getting people to do things that they would not otherwise want to do. Extrinsic motivators operate effectively, if your goal is compliance, you want to get people in seats, you want to get people to turn things in on time, you want to get people to say things in class, grades work for that. But if what you’re interested in is learning and quality, that’s what you need intrinsic motivation for. The grades can get people into learning spaces, but they in no way ever guarantee that a student will learn even though they are actually in the environment. So that’s really important. Environments that prioritize grades also incentivize cheating, and they just stand in the way of a lot of different things. But that’s just the academic part of it. Obviously, those are important, but to me, they’re less important than some of the effects of grades on students’ lives and wellbeing. Grades magnify and mirror inequities that have always been a part of the American educational system. For example, students who attend poorly resourced high schools have fewer educational opportunities, fewer textbooks, more teacher turnover, all the things that are tied to less-resourced schools. And what that means often when they get to college, they have experienced what we call opportunity gaps, which show up in their grades, especially in Gen Ed courses. So those grades that you see in the first couple of years of a student’s college experience, one who has experienced opportunity gaps, those are reflections of the past, they’re not indications of the student’s potential. They are indicators of systemic inequity. So that’s just one of many examples that we could rifle through. Grades are surveillance technologies. They’re often used for punishment, especially in high school, but kind of across the board. So that’s another category. inequities. And then the final one, the one that we’re getting more and more research on now, maybe than we’ve had in the past, and one that I personally care a lot about is that we have evidence now that grades are a contributing factor to the mental health crisis in teenagers and young adults, the academic stress caused by grades. We have a number of research studies pointing us toward the significant contribution of grades to that mental health crisis. So lots of areas here, I think, beyond the classroom. And that’s really our central idea of this book that grades have long afterlives, well beyond a semester, well beyond the classroom, that affect people’s lives, sometimes just in the short term, but often in the longer term as well.

Rebecca: Josh, you went from going from grades are no fun to grades are a super downer. [LAUGHTER]

Josh: Yeah, well, that’s the message. It’s a happy book, Rebecca. [LAUGHTER] It’s not going to win any awards for a happy smiley story, that’s for sure. [LAUGHTER]

John: One concern that some faculty have about moving to alternative grading systems is that, while intrinsic motivation is something we’d all really love to see in our students, there may be some tasks in our disciplines that students have to master which may not be as intrinsically rewarding as others, but they might still be foundational for students to be successful. If we move away from grading systems, what type of motivation can be provided to help students master those tasks that may seem tedious and may not be quite as intrinsically rewarding as other areas that students just find much more interesting?

Josh: Well, that’s a great question. There are a couple of things I’d like to address about this. So first of all, it’s not that we’re talking about either having traditional grades or having no grades, and nothing in between. What a lot of people are doing in the area of alternative grading practices is experimenting with a whole range of models. And so particularly for the types of courses and disciplines that you’re talking about in that question, John, I have found that many faculty gravitate toward a model called standards-based grading, where you can identify the skills, the content knowledge, the disciplinary norms and necessities that are important for students to develop. And the grade for the course is based, not on individual performance on exams, but how many standards they meet, over the course of the semester. And as a feature of that particular model, often students are given multiple attempts and multiple ways to meet the standards. So that’s part of releasing the pressure valve a little bit for students that gives them room to grow and honors the fact that individuals learn at different paces. So it doesn’t matter when in the semester that they hit the number of standards in order to get their A or B, because the process is a fundamental part of that grading model. So I think that’s really important. Another thing that often comes up in these conversations, though, is the fact that we do in fact, have gradeless colleges in America. The one I feature in the book is Evergreen State College in Washington. And they don’t have any grades at all. They have fully narrative transcripts. They give only feedback over the course of the semester. And they teach all the disciplines. So they have found ways to heighten the intrinsic motivation, and to use feedback to really help students navigate the path toward the goals that they have for themselves and for the class. So there are ways to do this. You don’t need grades to keep people in the seats or to have them do things that might draw on less intrinsic motivation. I think there are ways to structure our learning environments that allow us to do similar work without the pressure of traditional grades. And I think that’s the ultimate point here. I think what a lot of folks in this area who are interested in grading reform are trying to promote is not necessarily just ditching grades outright, although we could talk about that if you want, but reorienting students relationship with grades, the messages that grades send to students, so that it’s not necessarily an evaluation, but a tool helping them develop their skills and to push their learning forward.

Rebecca: It’s always been interesting to me that the A through F system was meant to provide some standardized ways of communicating between institutions yet, if you look at any single institutions’ body of syllabi, you can see that the grades mean entirely different things [LAUGHTER] depending on a class, like some might be about attendance, some might be about success on a test, some might be about achieving learning objectives. So it seems like if it was meant to communicate anything [LAUGHTER] across institutions, it certainly isn’t meeting that objective. I don’t know what my question is. [LAUGHTER]

Josh: I’m so glad this up, though.

Rebecca: I had a question, but I think I lost it. [LAUGHTER]

Josh: No, I’ll answer it. There’s a question in there, Rebecca.

Rebecca: Thanks for helping.

Josh: What you’re talking about there is what I call the measurement fallacy. And so there has been more and more work over the last few years, including one that I absolutely love, called A Century of Grading Research, where a team of experts dives into a massive amount of material. And the conclusion that they come up with is that a grade is nothing more than a subjective indicator by an individual instructor on a student’s progress toward that individual’s goals for a particular course. So I set the goals for my course, a grade that I would give is nothing more than an indicator of how much progress a student has made on my goals for my course. They call them learning intentions in this paper. It is not in any way, a kind of universal certification of learning in a particular course or discipline. Nor does it mean that the student who gets a certain grade in my course would get the same grade from my colleague down the hall teaching the same course. It is a truly subjective indicator of progress. And because of that, we cannot really say that grades measure what we have been told that they measure and what our educational systems have assumed that they measure, which is learning. They’re not universal measurements of learning, they’re subjective indicators of progress in the course.

Rebecca: And yet they’re used to make all kinds of decisions about students.

Josh: They are, and you’re absolutely right.

Rebecca: It’s very interesting. [LAUGHTER]

Josh: So I think there has been a lot of ill placed weight on grades without a subsequent amount of investigation into what grades have meant, and continue to mean. This is also what fuels the furor over supposed grade inflation. And there are lots of other tendrils of problems, when you begin to put so much emphasis on grades to do so much work in our educational system.

John: You mentioned Evergreen State College, but another college that had gone in that direction, very successfully was New College, and I teach in a program at Duke in the summer, and I had two TAs from New College, and they were two of the brightest people I had ever worked with, and their mastery of the subject matter was very much equivalent to that of other students I had who came from institutions with very traditional grading systems. So they certainly didn’t seem to be damaged by that. And yet, there seemed to have been a bit of a hostile takeover of New College. [LAUGHTER]

Josh: Yes, there has been but there is not evidence yet that the hostile takeover has affected that gradeless model. There was some discussion that I read in transcripts of board meetings about that grading system, but it has not changed yet. And I’m glad you brought up New College, John, because, and they have this on their website, as recently as last year, they were able to boast that they were producing students who went on to get the highest percentage of STEM PhDs in the country, relative to their size as an institution, which says a lot. If you are a gradeless institution, and your students are succeeding at that rate in STEM PhDs, it means that they’re learning not just content, but also the skills that are necessary to do that level of advanced work. So I think that that says a lot for what is possible, even within systems that do not have anything close to a traditional grading system.

John: And I should note that one of those students did go on to a PhD in economics. And the other student went on and picked up a master’s degree in data analytics. And they’ve succeeded very nicely, despite the absence of grades [LAUGHTER] in their college career. [LAUGHTER]

Josh: Imagine that.

John: When we began this discussion, one of the things you noted was that under traditional grading systems, the grades at the end of courses often reflect differences in the opportunities that students face before they enter our classes. Can you talk a little bit more about that?

Josh: Absolutely. So you have the reinforcing of those gaps, you have extensions of those gaps. So if you think about what happens to a student who comes into a college course with those opportunity gaps, and then is in a system, for example, where grades are curved, so not only then are they trying to bridge over those equity gaps, but their grades are really reflective of those gaps. But now they are also competing in a curved grade system with their other fellow students, many of whom have had more practice at the kinds of exams and the kinds of questions and the kinds of teaching strategies that they’ll see in those courses. So it just starts to pile on top of each other. And I think that this is something that we just don’t talk enough about, it’s just assumed, and many of these students are labeled unprepared or not ready for college, which places all the burden on them rather than this more systemic problem that I think we really need to face. Because we don’t talk enough about it, we assume that grades have to be a part of the landscape of education. And because of that, we, and I say we as the community in education, we’ve just been willing to tolerate all of the issues that grades have brought with them without really pulling back the curtain and looking at what the issues really are.

John: And we lose so many students in the first couple of years of college and many of the students we lose are those who come from low-income school districts, whose parents had less education, and who just come in with less preparation. And that’s not a very equitable way of providing an education.

Josh: Right, absolutely. And so this shows up on all kinds of metrics that colleges care about: retention, progress, graduation, all of which, by the way, are tied to grades and GPAs. That grades are the gatekeepers for keeping those students enrolled and moving through to graduation. So yes, that’s a major problem to address with respect to those students who are coming to us with fewer opportunities and from school districts with fewer resources. I think we need to really investigate the traditional ways of being In higher education, really look closely at them, reimagine them in order to create systems that have equity at the center and where we are actually, I think, invested in student success and helping those students from those different backgrounds to succeed.

Rebecca: I think the other thing to underscore related to equity issues is not only does an institution maybe have policies about grades and decisions are made at an institutional level, but at the federal level grades are used for financial aid. And so if you don’t hit a certain grade point average, and if you don’t have a certain number of classes that you complete successfully, so you’re not withdrawing from them, or having incompletes, etc, then you might not be eligible, you could lose financial aid. So whether or not a student has demonstrated growth in any kind of way doesn’t matter. It’s down to this idea of grades. And depending on the classes they’re enrolled in and the different things that grades mean, we’re essentially not allowing students to proceed because they can’t afford to.

Josh: That’s absolutely right. The more you really take the magnifying glass to this, the more you see how implanted grades are in all of these decisions, and all these key points in a student’s academic career, bringing in financial aid, I think, is a wonderful example of their gatekeeping function. And the idea that you’re raising there, that it doesn’t even give students a chance to try and bridge those equity gaps. It doesn’t honor their growth or development at all, it says you got less than a C average in your first year, therefore, we are not giving you any more money to move through the university, and so many leave, many dropout. And I think that there is a better way to do things.

John: And many of those students who leave end up with a fairly significant burden of student debt that they still have to pay, further increasing the inequity. What types of alternative grading systems do you discuss in your book, you mentioned standards based grading, but what are some of the other areas that you encourage faculty to consider?

Josh: Well, the book is divided into two parts. And the first half is all the problems and the second half is possible solutions. And so there’s a chapter for parents on what you can do in the home to help your children reorient their own approach to grades. And then the last chapter is about systemic change. But the one in between that is focused on what teachers in K-12 and faculty in higher ed are doing in their own individual classrooms to help with this. And so, there’s a whole range. There are the models that are related to standards-based grading, I call them the cousins: they’re standards-based grading, specifications grading, competency-based, mastery-based, proficiency-based, they’re all not very different from each other, they just have slightly different names, and maybe a few modestly different features to them. So that’s one bucket. Portfolio grading is one that I recommend for folks who just want to dip their toe in the world of alternative grading, because a portfolio model, you’re giving a lot of feedback throughout the semester, a lot of opportunity to revise and redo assignments. But ultimately, the portfolio that is turned in at the end of the semester gets a fairly traditional grade associated with it, it’s just that that grade honors the whole arc of the work for the semester. So that’s another one. Contract grading, and its various branches that we have recently seen. So classic contract model was developed in the middle of the 20th century. And it looks something like this: here’s a list of things to do for the course, if you do 15 of them at a satisfactory level… I’m just making up that number…if you do 15 at a satisfactory level, you get an A for the course, you do 12 you get a B, etc. That’s a contract model. More recently, there’s been a version of it called labor-based contract grading,…very prominent in writing studies… that tweaks it a little bit to emphasize more the amount of work, the amount of writing that students do over the course of the semester, and that is tied to fulfilling the particular contract. And then if we’re looking at a spectrum of grading models, with portfolio grading being one of the more conservative of the alternatives, on the other end of the spectrum you have what some people call ungrading and other people call collaborative grading where there are no grades throughout the semester, only feedback, lots of student self assessment, self evaluation, and then at the end of the semester, the students proposed their grade and the final grade is determined through a conference between the instructor and the student about that proposed grade. So there are lots of things that people are trying. I tried to send two messages about this, one is that my goal is hopefully to help faculty find models that will work best for them and their students, that it’s not a one-size-fits-all model. The same thing that works for me may not work for my colleague in the next classroom over. So that’s important. The other thing is that you do not need absolute fidelity to any one of these models. It’s not like Moses came down from the mountain, with tablets that you had to follow to the letter, lots of people are mixing and matching and taking elements from a host of different systems that they find works for them. So I’ve yet to find someone marching down the checklist for engraving or for contract grading, everyone’s kind of putting their own spin on it, and that’s good. Well, it’s actually not only good, it’s important since our contexts vary so significantly across higher ed.

Rebecca: As a lot of faculty start considering these different alternative models, collectively we can start to initiate culture change, kind of with a grassroots model. But systemic change requires policy change and other things as well. Can you talk a little bit about what role we might have in pushing forward some of those agendas as well?

Josh: Like I mentioned before, a major reason for writing this book was because my observation was that a lot of people are talking about grading reform, but they’re all coming at it, understandably, from their own perspective, the faculty perspective, the administrative perspective, the policymaker perspective, and the parent’s perspective. And I think that if we’re thinking seriously about systemic change, we need to have everyone on the same page collaborating to move change forward. All that is to say that I think about this question quite a lot. There’s certainly examples that we have of recent systemic change, some of the University of California schools have changed their grading systems in significant ways. Western Oregon just dropped the lowest grades on the scale, they’re no longer available to give. I just met someone a couple of weeks ago from Bryant University, they’re moving to collaborative grading at scale for their first-year seminar courses. So it is happening, what it requires is a network of people across an institution, all of whom believe that this is not only the right thing, but they understand how to use policy to make the reform happen, but also how to tell the story in a way that all the different constituencies can see themselves in it, and can agree that this is the direction that they need to head. So the networking is important, understanding how policy shapes grading habits and processes at a university. If you’re part of a public system, which I know you and I both are, you need to understand how the system policy and the state policy plays into this as well. So that requires having that network of different people at different positions in a university to really move that work forward. But what I really want folks to know is that you’re not alone in this, that there are lots of people thinking about this, and lots of people who are doing this work, sometimes under the radar, sometimes above the radar at institutions, and that one person taking a step is a step toward change. But multiple people taking the same step together begins to create a movement toward change. And so I want people to know that. I also want people to know that there are blueprints out there for how to do this work, that there are people who study grading reform, there are models out there for successful institutional reform. Given my work for the book, I think we have a lot to learn from K-12 school districts. There are so many of those each year that are transitioning to standards-based grading across the district. Last year, for example, the entire city of Santa Fe, New Mexico, all their school districts moved to standards-based grading. So this is happening. And the more we learn about process, the more we draw on our colleagues’ network and expertise in these areas, the more we work kind of as a collective in higher ed to push this forward, the more change you’re going to see.

John: We give a lot of workshops on campus and some of them are focused on alternative grading systems. We haven’t seen quite as much movement with that among faculty as I thought we perhaps might, because during the pandemic, a lot of people were open to trying some very different things. But there’s been some resistance. We’ve had a number of people trying it, but it hasn’t caught on quite as much as I had expected it to. Why are so many faculty resistant to moving away from traditional grading systems?

Josh: Well,I think this varies from place to place. But I will say that I think that a major thing that we all face as faculty is the pressures of time. Everyone wants to do their best for their students, I really do believe that, but when you’re faced with such a limited amount of time in which you can change elements of your course, you’re probably going to gravitate immediately toward the kinds of content that you’re teaching in the course in the assignments, the course design pieces of it, or you’re going to think about active learning strategy that John and Rebecca talked about a few months ago, rather than addressing the thing that is at the very foundation of our educational systems in America. That’s not going to be the place that you go first, [LAUGHTER] kind of an upheaval of everything that you have known about education. So I think some of it is just, in a system where we all have very limited time, and very few resources, where do you put your efforts, and I think that is driving some of that. I also think we’re kind of seeing this interesting bounce back that followed that period of innovation at the beginning of the pandemic. I think what you see is almost a defensive response to that period of innovation, that what we really need to do to bring students back and re-engage them in the coursework is to try and somehow recapture what our image was a traditional education pre-2020, that we need to move backward toward that rather than capitalize and extend the innovations that we were doing in the early stages of the pandemic. I don’t want to paint with too broad a brush on that, but I have seen some of that elasticity, that rubberband effect, in talking with folks across the country about some of these issues. So I think those two things are at the forefront of why some folks might resist that. And none of those really has to do yet with really trying to unpack people’s own philosophies of education, or how their grades and their grading models tie into their values that they have with respect to education. So that’s even kind of a deeper level that you can’t even get to until you address some of these other concerns.

Rebecca: And when we’re crunched on time, things that we’ve done before are easier to implement. And it’s also hard to find time to reflect on our practices and to do some of the things that you’re talking about, in thinking about how our values align with what we’re doing. We’re really good as institutions of talking about equity, but we don’t always fully analyze how our practices impact actual equity.

John: And we were all the products of a graded system. And we were somehow successful in that, or we wouldn’t be in these positions. And so I think there may be a little bit of psychological resistance to changing something that has been so fundamental to our own experience.

Josh: Yes. I think a huge capital Y-E-S [LAUGHTER] to both of what you’re saying, that Rebecca, your point, we are not very good at really interrogating how our practices may or may not be aiding our equity goals or advancing our equity goals. And John, yes, we have succeeded in graded systems. And I do think the psychological is a part of it. If we were able to do it, why shouldn’t other people be able to manage this? I think that is what some people think. And more than that, I often see a kind of defensive fallback. Part of this is natural, in that we love our disciplines and devoted our lives to our disciplines, but a fallback toward if I get rid of grades or if I change my grading system, what does that mean for the standards of my discipline, for how people will engage with my discipline? And so I think that’s a psychological element of this as well. And it comes out in arguments about rigor and standards, but what it’s really about is the individual psychology, I think, of the person making the argument.

John: Are there other topics from your book that you’d like to discuss that we haven’t?

Josh: I think the reform efforts that I have seen succeed, and those that have failed, always have hinged on communication, at every level. Why are we doing this? What is the purpose of it? How do we bring people into the process very early on at all levels. At the K-12. level, that means parents, teachers and administrators working together. I think at higher ed, it means utilizing the expertise of faculty right out of the gate, allowing them to shape the narrative and the conversation and the direction and draw on administrative and staff resources to help enact that vision, rather than having a top-down mandate that you had to change your grading. That’s never gonna work in higher ed. But I will say that the communication is what drives all of that work. And it is the hinge that either allows one of these efforts to succeed or fail.

Rebecca: Well, we have a lot to think about, but what’s next, Josh?

Josh: So, what’s next? Well, the book comes out at the end of August and so I’m really excited to launch that and to finally have it in people’s hands and have lots of conversations about what’s in there, hopefully, So, that’s what’s immediately next. I am thinking about the next project that has something to do with the students who are coming to college now are the students who their entire K-12 experience has been shaped by the Common Core, and the obsession with standardization in America, and so what does that mean for higher ed? And what does that mean for those students and their learning? So, I’m in the very early stages of trying to think about that a little bit, but that might be what the next project is.

Rebecca: You always have great projects, Josh, and get us thinking about really important topics. So thanks for your work. I’m looking forward to sharing your new book.

Josh: Well, thank you both very much. It’s always a pleasure to be on this podcast, one of my favorites, and I’d love talking to you both about all these issues, so hanks very much.

John: It’s great talking to you again, and I’m looking forward to receiving my copy of this book in the summer. I ordered it as soon as I saw the notification that pre-orders were available.

Josh: I appreciate that, John, thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

341. Learning Losses

The transition to remote instruction during the COVID19 pandemic resulted in dramatic learning losses. In this episode, Peace Bransberger joins us to discuss a report that analyzes the extent and persistence of these learning losses. She is the Interim Director, Programs and Evidence, Policy Analysis and Research, and Programs and Services at WICHE, the Western Interstate Commission for Higher Education.

Show Notes

Transcript

John: The transition to remote instruction during the COVID19 pandemic resulted in dramatic learning losses. In this episode, we discuss a report that analyzes the extent and persistence of these learning losses.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Peace Bransberger. She is the Interim Director, Programs and Evidence, Policy Analysis and Research, and Programs and Services at WICHE, the Western Interstate Commission for Higher Education. Welcome, Peace.

Peace: Thank you.

Rebecca: Today’s teas are:… Peace, are you drinking tea today?

Peace: I have drank tea and I ended my tea drinking portion of my day with a Trader Joe’s maple espresso tea.

Rebecca: That sounds interesting.

John: I’ve had some of their teas, but I’ve never had that one.

Rebecca: It sounds energizing.

Peace: Yeah, it’s a black tea, has a bit of a smokish coffee kind of impact from the espresso.

Rebecca: Interesting. That’s a new one. I don’t think we’ve had that one yet.

John: No, we haven’t. [LAUGHTER] Well, I have an old one here, a spring cherry green tea in the hopes that we will see spring here. We had a lot of snow in the past week. We’re recording this, we should note, in late March.

Rebecca: I have a Lady Grey today.

John: The Western Interstate Commission for Higher Education is focused primarily on post-secondary education, yet you issued a report which is titled “Navigating Learning Loss and Changing Demographics in Education” in February of this year. Could you tell us a little bit about why you had this focus on learning losses in elementary and secondary education?

Peace: Well, so my organization goes by the acronym, WICHE, you had it correct. We’re a Higher Education Commission. And one of the things we’re known for on the research side of things, because we do a whole bunch of other things to support the 15 Western states and then outlying Pacific territories, higher education systems, and one of the types of research that we’re known for our projections of the number of high school graduates. It goes under the long-standing title of “Knocking at the College Door,” and the projection of the number of high school graduates so that state and institutional planners can strategize around overall student flow trends. We last issued the update to that 40 year ongoing research in 2020, when COVID was first raging, and we issue these projections roughly every four to five years. So we’re in a prep year right now. As part of my job, and being the lead on the network, I am always monitoring K-12 trends data. So we’ll have a heads up about whether something would be monumentally different in the space of high school graduation. And as a result of what I was seeing, we decided in February to issue the report, kind of a summary brief, because the data were compounding and resoundingly indicating that yes, something is currently different, and might continue to be different about high schoolers, and younger K-12 populations as a result of COVID. We’ll go into detail on the learning loss side of things, but from the perspective that we really typically focus on,the numbers of high school graduates, the major demographic trends, the reason that we felt we needed get out in front of what we were seeing is because the learning loss, we see from that the potential that enough children and teens may have been so impacted by the learning disruptions and things that a quantitative impact on the actual high school graduation trend is possible. And that’s important to know, because it’s a second layer on something that I think we all kind of have on our minds, some people will call it demographic cliff, we don’t use that term, even though our data are used to depict the slope, the trend line, it’s the coming downturn in the number of high school graduates, because back in 2008, fewer babies started being born. And to this day, there has not been an uptick in the rate of fertility in the United States and across virtually all of the states. We know this, in fact, it could be next year’s high school graduating class that might begin to evidence some of that trend. And so people are front and center thinking about that demographic change, I would suggest, [LAUGHTER] at a minimum is a contraction in the youth population. I don’t know if what that means necessarily for higher education contraction, but we can talk about is learning loss going to do anything to help that? Are we gonna somehow see actually more high school graduates than we might have otherwise expected given C OVID? Or is it more like what I think we’ve probably all been waiting and worrying about, could it impact that trend and deepen it, amplify the downturn in high school graduates?

Rebecca: So you talked a little bit about the data suggesting losses in persistence of learning? Can you talk a little bit about what those losses look like?

Peace: Sure. And, just for our purposes here, I’ll speak to the national kind of overall results and trends. But I would strongly encourage your listeners, even just as a starting point, to go to the web page that I’m sure we’ll put in the show notes where the report resides. And within that page, I’ve been adding to the list where people can access more detailed data than the national trends. I’d go there because then you can poke around, based on your own institution, and get a sense of the kind of school districts that you might know, school districts that are kind of geographic areas that are really strongly important to your student populations. Because the detail is really important. It’s a really multifaceted, nuanced topic. So about the persistence of the learning losses, and this is in the K-12 pipeline. I mean, technically, we work in grades one through 12 data because kindergarten is not a universal requirement, so it can be hard to know what’s going on there, since the trend data could vary year to year. When I mentioned prior to COVID, or pre-COVID, in the K-12 school system, that would typically mean either the 2019-20 school year, or some folks go back as far as 2018-19, because the 2019 school year included the spring that was disrupted, but by then most learning and assessments had already occurred, and then the quote unquote, post-pandemic assessments that we have availability to summarize go through the spring of 2023. So that’s almost a year ago at this point. But by spring of 2023 students started, after a couple of years that we’ll discuss here about what really happened there, students started showing some resumption in the rate of annual learning and acquisition that was typical pre-COVID. So that’s just like, on average, in a given year, the assessments generally will say how close to on-grade-level and then was the amount of typical acquisition achieved. By spring of 2023, the good news was that annual rates, there was some evidence that students were a little bit more closer to back on track. The unfortunate problem, and otherwise not good news, is that students were definitely not on pace during the two previous years. So they lost total learning, and it sort of accumulated. Students would have needed to learn at really unprecedented rates in 2022- 2023, that year, where they are resuming sort of a typical rate, just to make up for two years of lost learning, if that’s even such a thing in learning, which is an accumulative kind of process. There are spring of 2023 results, there are some more recent results from several of the major assessment products for the fall of 2023, so getting into the current school year, beginning of the current school year, and they generally confirm what spring 2023 results showed, that students came into the year with the overall lost learning. At this point, it means that these K-12 students… and we’ll give some statistics by different grade levels and what have you, the nuance, but pretty much from the assessment results, you see the same trend virtually at every grade level, which is that students have been moving along, learning in the given grade that they’re at, but they’re still being bogged down by overall unremedied learning losses. And that’s for four years now, so that’s pretty substantial. One sort of point of reference for those students who were high school freshmen, as COVID was raging, their time is up. So four years, did they get back on pace? Were they able to stay on pace, such as I’ve just described? They’re gonna graduate now, and many of them will graduate, but not having been able to fully recoup what was lost. And so there’s not a lot of data that actually sort of compare, “Okay, so I’ve received my diploma, it was awarded to me. What amount am I behind?” And I think that’s part of the problem. In fact, there is increasing attention to the notion that grade inflation, that has always been something of investigation, but evidence that it may have really been at play during these past four years in a way that is really masking and complicating this issue, not making it clear whether students who are graduating from high school, would they be considered on par with previous cohorts that were emerging even prior to COVID?

John: So basically what’s happening is students seem to be learning at the same pace they were pre-COVID, but they’ve all been left behind fairly substantially as a result of that transition to remote learning. And they haven’t caught up to where they would have been had we not gone to that experience.

Peace: Yeah.

John: Were those losses roughly the same everywhere, or were they particularly bad in lower income communities?

Peace: Well, let me give you first even just a sense of the scale of losses, and some of this, you almost have to see it to comprehend it, but I think I can kind of show the scale. So this is high school, stick with high school students, and so they’re the ones most immediate to our faculty might see. It was reported in October, the high school students’ scores on the ACT College Admissions Test had dropped to their lowest point in more than three decades. And that was describing therefore the class of 2023, some of which are presumably in college right now. And they were in their first year of high school when COVID hit. The average ACT composite score for U.S. students was 19.5 out of 36, for that class of 2023, which was down from the prior year 19.8, which we’re talking already that those were some score levels that might not have been ideal to begin with. For as regards to SAT, total score declined for the class of 2023 as well down to 1028 compared to 1050, for the class of 2022 and compared to 1060 for the class of 2021. So really, those are just a couple of data points about this notion that schools are graduating students but what that means when they’ve graduated could appear very different by the time they arrive to college. Now, it’s hard. Sometimes people might poke holes on those type of data because ACT and SAT are not taken by every single student. So the other thing I’ll point out is that we’re focusing on COVID impacts here. But it’s important to point out that in those two assessment instruments, ACT and SAT, scores had been falling prior to the pandemic. And so the pandemic just accelerated those declines, accelerated and amplified them. Since we work in the demographic space, on demographics research, I’ve been talking to other researchers about possible reasons for that pre-COVID decline trend, and just, frankly, how hard it is to reconcile with graduation rates that had continued to increase over the same years, and then the grade inflation, so we don’t have conclusive answers on that. But it’s worth noting, we’re talking COVID. The question might be for faculty and instructors is, do things feel particularly difficult with incoming freshmen at this point, in some way, shape, or form, and probably in very nuanced ways, depending on discipline. But then it’s also like, are they feeling pretty good, prior to COVID, were they where you want them to be anyway? So assessment results from elementary and middle school grades, the one that provides some of the most normed results, and therefore can be compared over time and as a universal sort of indicator, is the National Assessment of Educational Progress, or NAEP for short. They’re the thing that really caught my attention. We tried to highlight where the score drops for 13 year olds, they’re no more or less important than any other grade level, or school age. But those are the next in line coming through high school. So we’ve just seen what was going on with the high school age students during that period. Well, the NAEP 50th percentile mathematics score in 2022, was 282. In 2023, it was 274. That was at the 50th percentile, so an eight point decrease at the middle, the decrease on the already relatively higher scores at a 90th percentile was six point decrease. So even the highest percentile, 90th percentile, had a pretty dramatic decrease between those years. And at the 25th percentile, it was a 12-point score drop between 20 and 2023. NAEP reading score declines ranged between three point drops at the 90th percentile to six point drops at the 25th percentile between those years 2020 to 2023. And so there, it gets to the topic that I’ll provide a few more thoughts on about the variability. Were all students affected by this? Which ones more or less so? Right there, that was a statement of a twice as large score drop for those at the 25th percentile, compared to those at the 90th percentile. And this is already on the 90th percentile, they already being, perhaps at or above a proficiency level compared to a 25th percentile, which might not actually be at a proficiency level. And on top of that, you have a steep drop. It’s also worth noting, just like with the SATs, and the ACT scores, that the NAEP scores in that 2023 school year, were just an amplified continuation, some declines that were already emerging pre-COVID, such that in the composite reading score it had by 2023, it was the total average, so at the 50th percentile, seven points lower in 2023 than a decade prior. So over the course of a decade, it was already reducing, and then 14 points in mathematics. So some of these things that we’re talking about is, I don’t know if you want to say learning loss or just what the best word to say it is, because it’s nuanced, but they were approaching prior to the COVID period. And so I really want to highlight that because kind of just in am analogy, prior to the pandemic, schools and students are already losing historical ground. So they were already maybe not in the best shape, so to speak. And now they have to also recover from COVID. And so that can definitely explain some of the lack of recovery and a slow recovery.

John: Going back to the issue of SATs and ACT scores, you mentioned some complications. I’m guessing the major complication is that fewer people are taking the SATs and ACT since at many colleges scores became optional, and the people who are most likely to avoid taking it are those who might on average, expect to do less well on the SATs or ACTs, so that may suggest that the losses would be even greater if we had the same proportion of students taking the SATs and ACT tests as pre-COVID when a larger proportion of schools required them for admissions.

Peace: Yes, that is true. However, the 2023 SAT scores, the participation was the highest ever. So maybe the 2022 that could have been a somewhat more appropriate consideration. It remains the case. We don’t know the underlying distribution of the students necessarily, and if they change year over year in consequential sorts of ways. But I think you’re right. I’m really looking for some good news on this topic. So I can be something other than a Debbie Downer. But the truth is, I don’t think we can look at this and pick away at the data. We went out because it was like if you download the PDF, and you’re not convinced just like access the 30 different year points or different reference tests, and what have you, and see if you’re convinced that this has happened, it really has. It’s pretty affirmative at this point, we’d love to see it turn around, but I don’t think we can just ignore it.

Rebecca: I think it’s really helpful too to point out that it’s not just COVID, the fact that you’ve underscored that, and it might be exacerbated by COVID is really important, because there’s a lot of blaming of COVID on many experiences that we have in the classroom, that may or may not actually be the cause.

Peace: I’d argue they are the cause of what’s seen with the past four years, but we can’t just pretend that that because it was so consequential over those time periods that even a return to normal would be where we want to be.

Rebecca: Oh, of course.

Peace: I think that’s the emphasis, normal wasn’t a good normal. And maybe we didn’t all look at it. It wasn’t so stark, somehow, different people might have been emphasizing it from an equity perspective. I would emphasize it from an economic perspective, because what I won’t highlight here is that there are researchers like Brookings, some of the think tanks, and then in other cases, some more consulting sorts of research organizations that are kind of putting out there, this has implications for the economy. I mean, we can talk about the implications for higher ed, and that part of the economy, but I mean, I just don’t think we can ignore past this, there might have been something brewing, that this was just a perverse sort of way to get our attention on some of it about what the youth of today need? Where do they stand? Are they getting prepared well enough in a way that we need to support the workforce of tomorrow. That’s not the only reason for higher education, but as you and I decide to go take our retirement, these are the kids who will be supporting the country’s economy, and there will be fewer of them. So their ability to do that is really important. So I think, if nothing else, it could be a wake up call. We should really wake up, but we don’t have to wake up screaming and yelling in the house like the fire alarm going off, we need to figure out what to do.

Rebecca: One of the other issues that your report underscored was some high rates of absenteeism. And that’s certainly something I’ve heard my colleagues talk about as well. Can you talk a little bit about some of the potential causes for that?

Peace: Yeah, I will. I also do then want to make a note about something else, but I’ll respond to the absenteeism. So the statistic, 30% of students nationwide were chronically absent in the 2021-2022 school year. So that’s two years into the quote unquote, pandemic period, which is double the pre-COVID19 average. And while not comprehensive, the preponderance of data, were suggesting only minor improvement in the most recent completed school year, 2022 to 2023. That’s huge. Now, chronic absenteeism is different than like average daily attendance and what have you. But still it was a doubling. Absenteeism is the question. I mean, the question is, is it a symptom or is it a cause? And it’s a little bit of both. Prior to COVID students with more day-to-day life or learning challenges were on average, more likely to be absent from school, and a real reason to be absent from school, especially given the kind of hysteria that was almost necessary. As a parent, I got this during COVID. I’m like I was sending my kid to school if they met the temperature well enough for them to go. But being sick is a valid reason for absence. And that was made so much more evident with COVID. And some households and students are just simply more likely to be sick or not recovered as solidly. Now, of course, some of them might already be vulnerable students by virtue of a health condition, but you’ve got students and families that due to their living conditions, or health care access, might be more likely to be absent. One of the phenomenon, if you will, or factors, is social prejudices, and hostile environments for some students more than others. So the Asian and Pacific Islander communities experienced more of that during COVID and that may be lingering in their attendance decisions and the Black Lives movement put in the spotlight the types of stresses that black students might face at school. It can be rational to avoid school, and at this point, some fatigue with that might have set in. So, but even let’s talk about the marginalized students, and is the average student’s disposition to attend school affected by this point in some way, because if it is, then it’s amplified for marginalized students. So school and education that we as adults just talk about and encourage our children to, try to guide them through, pull them through, whatever. They might have become synonymous with very easily influenced young children and their emotional memory with online learning and masking and fear of sneezes and coughs, let alone than what it felt like go back after being socially isolated. And my kid experienced, even in the higher achieving classes, just an unusual rate of disruptions from students transitioning back socially and stuff like that. So these are children. And that can be a far more formative experience. I’m not a psychologist, I can’t say trauma, what have you. But that can be something that that’s all you know, for some of them or a big part of your recent memory. And that can be all you can think of as school, so to ask me to go tomorrow, I might be relying on that recent memory. So I can understand any student in K-12 to some extent, also. Hopefully, as you mature into an adult, you’re able to sort of equip yourself to move past those things. But some of these young adults really having a lot of emotional memory that makes this a real sticky issue, the absenteeism or the lack of kind of bringing their best to the educational setting. I mean, if you want more factors, if that’s not enough, school transportation issues for the past two years and kids literally not having a way to get to school. You’ve got teacher fatigue, and we know how important instructors are in the classroom and what you can bring to it, your ability to do that. And if it couldn’t get worse, because I lived through this with my kid, you still got an unrelenting possibility of like school violence and mass shootings. So there’s a lot of reasons that school does not feel like running through the corridor anything, you know, that maybe we all might have felt as a more positive thing. Now, things hopefully, the last, maybe a year or so where kids are able to start washing some of that out of their memory, and it being replaced with a more normal environment. And hopefully, that’s a good thing for them.

John: One of the things that shows up in the data is while there were learning losses across the board, I believe the learning losses were a bit worse in the area of math. And those seem to be having a pretty significant effect, or at least from what I’ve seen in the classroom, that’s been having quite a bit of an effect on our incoming student body and may have a significant effect on their choice of majors. And we know the rate of return to education in the STEM fields is dramatically higher than it is in other areas. And in terms of the state of the economy, that’s something that could have a very negative impact unless we provide some ways of helping students get caught up in some way. What can colleges and universities do to try to bridge that gap, to take students who, on average are coming in at lower levels, and get them up to the level that they need to be at to be successful?

Peace: As you and I must have been reading some of the most recent coverage on this topic, even just this week. So I can dive into your second question through the lens of STEM. So yes, I had seen some stuff about it more from a HBCU perspective, Jill Barshay of The Hechinger Report, she often does deep data dives. And so earlier this week, she released some interpretations highlighting how the NAEP, those national scores for the K-12 population, those and similar results could conceivably suggest a narrowing of the STEM pipeline for what you’ve mentioned. And so it feels like there are a couple of really interesting points on that… math, at the very least, although clearly, reading comprehension is also very important for sciences and anything, obviously, but those more technical reading types of disciplines. Reading, it cannot be forgotten. So what’s maybe most worth thinking about from what she highlighted was the top students, the NAEP results, you’ve got it 75th percentile 90th percentile, what have you. Top students are staying on grade level, according to those data. And those top students, of course, are maybe definitely the front of the line on the STEM pipeline. But the eighth grade NAEP shows that far fewer of even those who are in the top portion are hitting an advanced performance level or even proficient. So just because you’re in the top, it’s a grading curve, so to speak. Top might not mean what we need for STEM types of disciplines. So, there were learning losses across the board, math scores among the top performers dropped as steeply as did the scores among lower percentile scores. Okay, they call out even the scores of students at Catholic schools. So we understand that that might be a place where some of the STEM students could be concentrated. Otherwise, the scores from those schools would indicate that they weathered the pandemic pretty well. But scores in eighth grade math plummeted. And I just think that that’s another one of these big wake up calls, and it’s in the microenvironment of STEM, but the importance of it to the economy, obviously to the colleges and universities for which that’s a key focus. Now, what might you do even just on this topic, because then I think we can get into a little broader discussion about what to do. I would just ask STEM faculty, if this is the case, if these are the facts, it’s the real fact of the matter. Let’s just free think a little bit and see, to what extent could you meet students at a lower proficiency level if needed. So if it can be quantified, they’re 10% off what you think should be the criteria for even beginning the STEM disciplines, then what have you? If that’s what you have, if that’s going to be sort of the circumstance of even your top applicants, can you do something differently to allow them to actually be admitted? …get on track? What can you do? What would you need to do to actually maybe bridge that distance? If it’s larger, I mean, then obviously, you have to go a little bit, quote, unquote, deeper into the pool or the topic. But if you haven’t, for a while, really look at some of those criteria, sort of indicators and stuff. Because otherwise, we go through the admission cycle, and you might for an entire year of students miss some who could really, with the right approach, potentially continue on their aspiration to STEM. I’d also say, and I don’t really know how this plays out for faculty, and maybe it’s a pie in the sky kind of idea. But we’ve kind of been hearing it from some of our state folks who run the boards of regents and these other sorts of things, which is recognizing that this has occurred, recognizing that it’s always been questionable or difficult necessarily to know, if you could get a guaranteed STEM pipeline, to what extent colleges start reaching backward a little further into the actual high schools and be part of their exposure to and understanding that I might be like, let’s say the eighth or ninth grader, I actually have really, really loved the idea of becoming a scientist or going into medicine or something like that. But I’m starting to waver with my math skills or something. And so these kids aren’t really quite aware. And they’re probably already thinking college and that kind of thing, even at that young age. And if they get a sense that they wouldn’t be admitted, or I’m going to be a failure that early, then they just lose the aspiration, among other things that kind of erode aspiration sometimes in the STEM disciplines. We’ve been hearing from some of the stakeholders, maybe just a real need to actually start acknowledging out loud, whether we can meet students where they are, could we meet them where they are, because they’re the ones who lived this, they know how hard it was. And so their sensitivity to maybe that kind of like, work really hard, and then not actually be able to get into the program they desire and stuff like that. So much of it’s the right thing. But it really comes down to the emotional reaction and decision, as much as quantitatively, could they be close enough to be accommodated, which would be in our better interest if that’s even a possibility? We have to be looking at, I can’t say up front, revise anything, but we should really be, in light of what’s occurred in COVID impacts in K-12, I think we should really be looking at what are some of the hard and fast admission criteria and stuff where they exist. Now, it’s true, like less selective institutions may just end up dealing with the majority of students who have experienced learning impacts, as they always have, but given the fact that even among top performers, there was learning loss evidence, I think we can’t, in any institution, sit back and say, well, it won’t be our problem. So what is within the realm of possibility to meet students where they are, which might be somewhat off of what we would hope. But if it’s not drastically off, for example, then at least we’re taking one step in the direction of meeting them. Because I don’t know how controversial that is. [LAUGHTER] I’m a data person, so from a data perspective, it is one of the few things that I see as a real possibility as you try to make those data points overlap.

Rebecca: So we focused a bit on STEM, if we broaden that a little bit to what universities can do. We talked about admissions criteria, are there other things that we should be thinking about to help our pipelines for all of our fields and disciplines and thinking about the future.

Peace: Yes. What can we do? There’s a sort of like current and then future tense implied by that question. What I would say is, we should have already been doing something. And the reason I say that is because “Okay, so we hear that there might have been some observable, pre-COVID developments on how prepared students were based on those pre-COVID assessment score declines.” So I would ask the question, “Was this not something that folks already were having to, in the margins, sort of deal with? And did they start doing something?” Because if so, do more. Look at the possibility that there should be a sustained, broader perspective. The other thing is that, prior to COVID, the rates of college enrollment, for example, among some of the previously lesser served student populations, Hispanic students, and two or more races, the rates of enrollment were really going up. So were colleges already having to address something about what had already been a changed student population, but for some reasons other than COVID. So again, if you hadn’t been, I think it’s really compelling, you’re going to have to now, but we can kind of maybe step back and say, “Well, what did we do?” Sometimes we forget, we were just dealing with stuff in the moment. And so if we look back, just go back to prior to 2020, and then start thinking about, “Oh, what have we tweaked over there or something,” if that was happening, that would give evidence of what you might consider doing now. Because you might have already been making some adjustments, You might have been piloting some things, you might have only been piloting them with the expectation that it wasn’t something that needed to go full scale, see if they’re there, and approach it from that perspective. As regards to helping students with academic preparation needs, it’s a different situation, but it overlaps with the topic of other types of student supports, because student attention, even if they have the aptitude, might be missing some of the content knowledge. But if they have the aptitude, if their attention is distracted from not only the perennial sorts of things, that some students have to deal with, work demands or lesser educational advantages of many different perspectives. Now, they also might have that academic learning loss, that if we do put some of that supportive environment in place, then could you, STEM or otherwise, meet students at a slightly lower bar, and then still get them successfully where they need to be. We’ve been trying to do that for different student populations for a while, but some of the data would suggest just do more of the same, and until something comes, for example, K-12 data about what to expect with incoming freshmen, expect to sustain it is what I would say. I listened to some of the podcasts that you pointed me to from previous episodes. And I will say one that really resonated with me was the one about relationship-rich education. And then there were several other ones, each of which really kind of touched on various aspects. But I think that relationship-rich education episode, it was specific sorts of interventions, a lot of which, as it suggests, are not specific academic intervention. But they’re the things that we are creating learning spaces, and whether we mean them to be punitive or not, they can be sensed as punitive for students who just really had a difficult four or five years, that about they’re sensitive, so to speak. But to be intentional about learning environments, that don’t take a lot of specific kind of empirically vetted interventions even but intentionality about airing some of this, I would say, with students, like if it can be a discussion point, and you have students who are really feeling the spotlight is going to be on them because it felt like it was really hard to get through my senior year and now I’m going to give this a go. And I know it’s supposed to be challenging and stuff, but maybe they know what part of their senior year or math class was the most difficult for them, if they’re given the space to kind of articulate these sorts of things, it doesn’t have to be in an open discussion forum in a classroom, maybe not, depending on what you need to talk about. But just making it clear to students that they can actually identify some of those needs, that they will be required to be the most responsible for their own learning, but even though we’re going to keep emphasizing standards, and do everything, that we actually do mean to support them, and that we see their success in our best interest, and therefore we’re open to listening, to hearing, to believing what they say. So I would say believe it. On a spectrum, there will always be some people who are maybe struggling the most or otherwise, we would maybe take a general approach that anyone who’s saying some of this is complaining. I would say the evidence would suggest believe [LAUGHTER] that whether we thought it should have been easier for the kids, it impacted them. And so believe it and open up the possibility that if they say what they need, they might be able to identify something for us to do, it could be far simpler and smaller. Some of it can be more time consuming, but maybe if it just becomes common practice to imbue our classrooms with this sense. Students themselves can support each other, that we can hear what they say they need to support them, and it might not be half of the things that we’re worried to mention out loud because we can’t promise it. It’s nothing brilliant, I apologize. And I wouldn’t be the person to speak to in instructional sorts of research, but it definitely resonates with these academic impacts as a result of something that was a societal experience, that we need to be in the space, not just of academics, but of what part of learning methods actually are important for learners. And I’m an adult educator. I have been an adult educator. I wonder, because when I listened to some things that are more about like instructional approaches for equity and for other sorts of things for adult learners, and just what I know about the science of adult learners is I wonder if some extent, this current, quote unquote, generation… I don’t know if it’s an entire generation, but certainly, maybe 10 years worth of students… have actually had adultified in ways that maybe bring them into a space where some of the methodologies that we use in our learning environments, we might learn something from actually thinking about those adult learning and education methods. I think to have to grapple with some of the things that some students, that the entire spectrum of students, it wasn’t just pockets of students have had to deal with, maybe they’ve adultified in some ways, and then yet are not showing it because they don’t have the skills they need from school, I might advise if people kind of consult with what are some things that would be different in an adult kind of focused classroom compared to some of the classrooms that are more typically going to be populated by younger students. There might be some methods there that they can be common sense, but they’re not obvious.

John: One other topic that has come up recently is that colleges were a little bit more flexible during the pandemic in terms of dealing with things like administrative holds, and so forth. Many colleges are starting to put those back in. And one of the implications of that is that students may not be able to register for classes at the start of the term and they may be coming into classes after other students have already been in a class for a while. And I’ve seen that myself this semester, in a way I haven’t seen it since COVID. Is that something that colleges perhaps should be a little bit more careful with?

Peace: For reasons that probably don’t have to do with COVID or anything… but yes, as most things go with COVID, it just amplified possibly. I’d say yes. So on an entirely different sort of research project that I’ve recently worked with, WICHE, my organization, led a action research study of sorts with 12 public colleges and universities. And they each did their own comprehensive data analysis on this topic of every single possible hold a student could get. I mean, it would be a registration hold, like limiting their registration, or maybe access to records or something, but it could be for academic probation, and it could be for paperwork of any sort, it could be for financial aid administration, advising holds that restrict registration. They went comprehensive, they dug deep. And in the first post-COVID academic year, which was 2021-2022, by which I mean, mostly removed from the funding supplements, more than 265,000 holds were placed on roughly 125,000 students across those 12 institutions. And there is wide variation across institutions on per student rates, and stuff like that, and the reasons for them and the observed outcomes that they appear to be having on even just the next-term persistence for students. But by and large, every single institution, we’re able to, by looking at the data, find certain segments of students, part time, certain colleges and disciplines that really needed some attention for what’s a wide-scale, maybe not problem, but certainly a wide-scale sort of thing that each of the institutions would say they didn’t know how to control it. One University, for example, found that a single academic department and this, of course relates to our faculty listeners, place the bulk of all the advising holds, and a significantly higher rate per student than any other academic department or college. And it turned out that these advising holes were well intended, had developed over time as a way to manage the major requirements. But the college never got a bird’s eye view of the whole picture about how they were just sort of being administered. So when the research team at that university brought the data to the Dean, the Dean immediately recognized the holds were not operating as they were intended and took action to substantially revise how they were used. That’s advising holds, and that’s one of the most frequently used type of holds, even though financial holds get a lot of attention for the right reasons. Institutions from those 12 are also reconsidering the exact timing of registration holds within a semester in case that they’re just being too preemptive. Like, it’s easy to just be like “Mark all XYZ-term students not to be able to register until advising” and what have you. I mean, it’s cost effective, it’s kind of solution at scale, if you will. One institution experimented giving a small cohort of students, those who are at risk of academic probation, the ability to actually register at the usual time during the semester with all other students. And then they only denied the registration at very end of the semester for the very small portion actually, even from those students who were still failing. And that small experiment for that university indicated that there wasn’t a difference and no benefit from preemptively limiting registration for the whole swath of students. So why not consider changing that? …especially if unknown, some of those students might have otherwise been impeded. And I want to really mention that this is for everyone, because you, in your seat, you don’t know what other holds are being used around the institution. So any given student is not only receiving the results of the one that you’re using for the right purposes, I’m sure, but they’re receiving any number of these. And if you dial back and see the full scope, often, at least at first glance, you got like low-hanging fruit all over the place that you can reduce them. There was repeated evidence in this study that some registration holds actually did the opposite of what they’re supposed to do, or intended to do, which was to advise students so that they would take the courses that they needed. So then we heard from students, and then some of the evidence that institutions started investigating, that the mere fact of not allowing the students to register during the peak registration period when other students were competing for classes, led them to register late and take classes they don’t need. I mean, they were going to take credits anyway. And could that actual hold be the reason that they end up taking and paying for these courses that they don’t need? Now, we know that’s not what we intended, we intended that they’re taking the right courses, so there are just different way to arrive at that. And then finally, on this topic, the FAFSA… well, I’m going to have to use the word that I see in the press, it’s not my opinion… mess, that I think we need to be ready, at least in this coming fall term, that there will be students and they would be students who have financial aid, who may experience untold, even if they’ve made it through the process they choose to enroll, they could face untold additional ripple effects, one of which is that holds on records and registration are part of the financial aid administration process, so if that has been delayed, and God knows what kind of other sorts of messes have accumulated in that space, if summer is the period during which most of this should be resolved, but students may not be engaging, definitely not as be accessible during summer, I think we need to be ready. And this includes even faculty being aware of what might be happening, or something you don’t know about a given student is struggling with just something like a paperwork mess that’s distracting from their studies. It’s distracting from their attendance and what have you. The more aware we are that could be happening, and it’s told even just through the data with holds, I think it’s just one of those things to be like, why not be that aware? Why not put it out there and be like, “If something other than your coursework, for example, even your financial aid administration after a kind of rough… you know, whatever, say the right words, to characterize it… please let me know so that I can be aware and you can move past that sort of thing.” These things that just add up and distract students who might otherwise be capable in the academic content. So just a lot of different things, honestly, about administrative processes, that really well intentioned, and in many cases can be proven to help support students in that, but just the administration of them, in this case it’s evidence through like holds, needs to be revised continually and kind of perpetually revised, because at the very least, each of the institutions and it wasn’t just these 12 I mean, research by the American Association of collegiate Registrars (AACRAO), and then also ITHAKA S+R had done some research on the topic, just revealing the scope of those administrative processes. Administrative processes should not be almost like a second admissions requirement for students, if they’ve been academically admitted, they shouldn’t be derailed by having to decipher something that literally just may not be well managed, because it’s accumulated over time.

John: And we think that would disproportionately affect first-generation students, where parents are not giving them as much guidance, perhaps, in terms of navigating all those little hoops that they have to jump through.

Peace: Yes, one example here, we’ve got financial aid recipients, which are not just first-generation students. I am a first-generation college graduate. And I only know now what I didn’t know, and thank God, that kind of thing did not stop me because I can look back and go like, “Wow, that was decades ago.” What I would say is the experience that I had, and I may be the case study of one having been exposed to some of these findings with the holds, I as a parent will not stand for that. If I get wind of it with my kid when she goes to college. Whether I would or not, since she’ll have to manage her own affair and stuff like that. But she actually knows about it now too. And just that’s no more than I would stand for a lot of things with my health insurance that were giving me hassles or my paycheck or anything else that’s really super important to me. When it comes to the administration, this is not again, it’s not like pointing fingers or anything. Things just develop over time, and they need to be revised and revisited. Not least of which because you have a new generation of people, but also just because the computer gets buggy and all of a sudden it’s really standing in the way.

Rebecca: You’’ve given us lots to think about. Thanks so much for all the work that you do, Peace, and deciphering it for us as well.

John: We always end with the question. What’s next?

Peace: Well on an organizational news level, we’ll be planning to really see update of the high school graduate projections in the last quarter of this year, 2024. That’s a big huge thing, especially given what I’ve just revealed to you. It’s hard to make projections or predictions about anything, I still don’t feel very much on solid ground there. And you know, I just want to mention on a personal level, me here sitting in my office, not a faculty office in the outside world, so to speak. I’m just really being intentional nowadays, like, I never have been before about compassion with myself and my colleagues. If I had students it would be compassion with my students, because it just really feels like things… zs we know, again, we just had the Debbie Downer discussion… things have been pretty frantic for years now, and it doesn’t feel like there’s any end in sight, because we’ve got some things looming on the horizon. But I’ve been really noticing that a few moments of silence and reflection, like literally just a couple, two to three moments, it goes a long way to getting me further than the two or three hours of just unrelenting pounding away at work that I also end up doing, so I mention that. We have to be kind with ourselves, no matter what we’re doing, and with our colleagues, and I would advocate for that, the compassion and kindness, bringing that to the learning environments can really go a long way, I think.

Rebecca: That’s a really good reminder, when it feels like there’s so much work to be done for sure.

Peace: We can do it.

John: …and having data on incoming students can help prepare us for what’s to come. So thank you for your work on this.

Peace: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

339. Industry to Faculty

Some faculty begin teaching as a second career, after working in industry. In this episode, Kevin McCullen and Michael Walters join us to discuss how their prior careers in industry helped prepare them to design authentic learning experiences for their students.

Kevin is an Associate Professor of Computer Science at SUNY Plattsburgh. Prior to joining the computer science department at Plattsburgh, Kevin worked for several years at IBM. Michael is an Associate Professor and Chair of the Physics Department at SUNY Plattsburgh. Prior to joining the Physics faculty, Michael was the CEO of EISWorks Technologies and a metrology engineer for Corning Inc.

Show Notes

  • Design Automation Conference (DAC)
  • Consortium for Computing Sciences in Colleges (CCSCNE)
  • Clark, D., & Talbert, R. (2023). Grading for growth: A guide to alternative grading practices that promote authentic learning and student engagement in higher education. Taylor & Francis.
  • Lang, J. M. (2008). On course: A week-by-week guide to your first semester of college teaching. Harvard University Press.
  • CircuitPython
  • R.P. Colwell, At random – Employee Performance Reviews, IEEE Computer, 35(9), 12-15, Sept 2002

Transcript

John: Some faculty begin teaching as a second career, after working in industry. In this episode, we discuss how prior careers can prepare faculty to design authentic learning experiences for their students.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are Kevin McCullen and Michael Walters. Kevin is an Associate Professor of Computer Science at SUNY Plattsburgh. Prior to joining the computer science department at Plattsburgh, Kevin worked for several years at IBM. Michael is an Associate Professor and Chair of the Physics Department at SUNY Plattsburgh. Prior to joining the Physics faculty, Michael was the CEO of EISWorks Technologies and a metrology engineer for Corning Inc. Welcome Kevin and Mike.

Mike: Thank you.

Kevin: Hello. I will just say 32 years is several.

John: It is. [LAUGHTER]

Rebecca: I think that’s the official definition. Well, today’s teas are:… Kevin, are you drinking any tea?

Kevin: I have Harney and Son’s Hot Cinnamon Sunset.

Rebecca: Oh, that’s a good one.

Kevin: It’s my go to tea.

Mike: And I accidentally left my tea in the car, but I do have a cinnamon tea that is by Tazo.

Rebecca: Yum..

John: Very nice.

Rebecca: Cinnamon’s are a favorite at my house.

John: I have that too, and I enjoy that one. Today, though, I have a spring cherry green tea.

Rebecca: And today I have Hunan Noir, which is very tasty.

John: Each of you received a PhD and worked in industry for a number of years before joining the professoriate. We’ve invited you here to discuss the transition from industry to academia. Many of us just went to school and never left. And we thought it would be interesting to hear the perspective of people who’ve been out there working and returned to academia. Could you tell us a little bit about your initial careers in industry?

Kevin: Well, actually, I took the roundabout path in that I joined IBM after my bachelor’s degree and IBM paid for my graduate work through programs that they don’t have so much anymore. And I always wanted to teach. And when I graduated as an undergraduate many years ago, I was kind of burned out on school. And then it gets hard to leave after a while because it becomes very comfortable. But eventually I kind of felt like it was time. I was becoming I would say more uncomfortable in the situation I was in in industry and opportunity presented itself. I had actually been looking for a number of years for a good local opportunity because I didn’t want to relocate. My wife still works for IBM. And Plattsburgh had an opening and I applied for it. And there’s a very funny story in there with the conversations with my management over that. But I applied for it, and they accepted me, and it’s been a lot of fun.

John: You mentioned a funny story, I think [LAUGHTER] that requires a follow up.

Kevin: Oh, it was just that I had submitted a presentation to an industry conference. So I’d gone through all the clearance work to get it approved, patent clearance and all those things, and it was not accepted. And then when the position opened up, and I applied for it, and Plattsburgh invited me to come over and give a presentation, I went to my manager, and I said, “So do you remember that presentation that we got approved for DAC? Can I go give it at SUNY Plattsburgh?” And she said, “Why?” And I said, “Well, they have an opening, and I’d like to apply for it.” And I said, “Don’t worry too much about it, because my guess is that they can’t afford me, even if they do give me an offer.” And she said, “Sure, go ahead and do it.” So I came back to her about a month later. And I said, “Good news or bad news. The bad news is they can’t afford me. The good news is I’m going to take the job anyway.” And we parted on good terms.

Mike: So I did get my PhD before starting in industry. And I sort of backed my way into industry. I was thinking about staying in teaching, but I was worried I wasn’t a good enough physicist to actually go for it. I have impostor syndrome very badly. And so I looked at going into industry because I was worried I was going to only teach freshman physics for the rest of my life, because that’s the only thing anybody would trust me to do. I went into industry for nine years, I did not have to approach anybody to see if it was time to leave, because they approached me and said, “Congratulations, you work your way into a research position at a production facility. That’s a pretty awesome job. And now we’re in a recession. So we don’t need you. Goodbye.” [LAUGHTER] I applied to a couple places in industry, had a position semi-offered to me at a solar panel facility in Oregon. And I could not say to the person who’s trying to hire, “Do you want this job?” He asked me three times. And after the third time, his shoulders just slumped and said, “You can just tell, okay, that was done.” And on my way home, my wife asked me, “Well, how did it go?” I’m like, “ah, I didn’t get that job.” I told her what happened. She’s like, “That’s lovely, dear. You have to figure out what you want to be when you grow up because we need a paycheck.” And at that time, I said, “Do you mind if I tried to go back into teaching? I think I really want to go back to it. Maybe I can not teach just freshman physics.” And so I adjuncted for a year at two institutions near my parents’ house. And SUNY Plattsburgh was looking for somebody who had a physics background but had engineering experience for their engineering three plus two program. I was a visiting professor for a year and then worked my way into a regular position.

Rebecca: I think there’s a lot of folks that are considering moving around and shifting careers at different points in their career. Can you talk a little bit about what that actual transition felt like that first year, maybe, back in academia?

Mike:Well, I can say three things that strike me when I was moving back into academia. Number one, I surprised myself finding out I can teach something besides freshman physics, so that was a great thing to figure out in getting some confidence there. The second thing was, and Kevin and I have joked around about this before, the pressures of academia in general, compared to the pressures in industry are at different scales. [LAUGHTER] And so we used to have fun when people would come up and talk about the pressures of doing stuff, we’d sort of chuckle a little bit, and go,”Yeah, this is pressure,” and I respect it, because there is definitely pressures in academia. But we can also talk about the times when you’re sitting around the office going, “Am I on the cutting block this time around?” …because you know, layoffs are coming this month, or even if you’re not on the cutting block, looking around at your friends and going, “Who’s not going to be here next month?” …is not a pleasant feeling. So being in academia made me feel more relaxed. I didn’t have tenure yet, but just the idea of knowing you belong, and you would know, hopefully, coming up if something was going to happen that way. And lastly, the camaraderie of the department … I am blessed to be in a department that was a very close-knit department. They were very supporting, they felt bad that initially, my office was in the middle of nowhere in a closet, basically, because that’s all the space they had. Kevin, I was on the fourth floor in one of those little side cubby holes. I only could see the sky from a skylight, literally everything else was cement.

Kevin: I thought you were talking about the office I first saw you in which also resembled a closet.

Mike: Yes, well, that was a different closet, [LAUGHTER] but it was a better closet. But anyhow, it was great having that camaraderie and having that trust, and that trust grew into a new major, because they trusted me to go ahead and take out the robotics major, and kick the wheels and let it go out for a spin.

Kevin: For me, it’s autonomy. I see a lot of people, I read the Chronicle and such, and it’s like making the transition to industry, and I’m thinking they’re going to have an interesting end of the year when they sit down with their manager to talk about how they did against their goals for that year, because it can be a little head spinning. My first year, I kind of felt a little lost, because it’s like if you had a guide, if everything you do is coming down from above, even if we get to a relatively high level in an organization like IBM, you’re driven by strategies that are sent to you and you are a piece of that strategy. And now you’re kind of an independent agent. And it took me a little while to get comfortable with that. But Mike and I both know people who really, really are struggling with the pressures of academia and all the things. I feel like I have a lot more ability to say “JNo,” and to say, “No, this is my limit of how much I am willing to take on and so I’m just going to steady on here.

John: I was talking to one of my advisees, who’s planning to go into a PhD program. And he said he was researching the market for a PhD economist, and he noted that jobs in industry paid a lot more than jobs in academia, and jobs in the government was somewhere in between academic jobs, and that, and he asked why there was such a big difference. And I used basically the argument that you just used, that you get a lot more autonomy when you’re in an academic setting, in terms of research, in terms of what you teach, in terms of what you focus on. And that’s something that I think we all value quite a bit. Was there anything that was surprising when you made the transition to an academic environment full time?

Mike: I’ll go with the autonomy. I mean, that was really surprising. Where all of a sudden nobody was breathing down my back. Where are the deliverables that you were supposed to get here? Other than getting classes together and doing your best that way? Yeah.

Kevin: I’m gonna go back to actually, it was a funny question I asked the Dean when I was hired, because I have kind of a long commute, as does Mike. And I was a little concerned about doing a commute from Vermont to New York five days a week on the ferry. And I asked the Dean, what are the expectations in terms of like, where you work, because even at IBM into the 2000s, we did a lot of working from home, pretty flexible work environment. And he said, one of the biggest changes when he moved out of teaching into administration was an expectation that he was in his office. And it’s the freedom and the flexibility. I’ll say one other thing, that was kind of weird, though. It’s the summers, and I’m a volunteer with several organizations. And immediately there was an assumption that I had nothing to do during the summer, and that I would immediately become available to them. And what I’ve taken to telling people is, the way that summers work is, I have a lot of things to do, but nowhere I have to be. And by the way, biggest surprise is that from what I have observed, we have the whole summer and everyone still does their syllabus three days before the semester starts.

Rebecca: We’re deadline driven, [LAUGHTER] just like our students. We are no different and that’s for sure. Can you talk a little bit about how your prior work experience has shaped your teaching practices.

Mike: So when I first came back into teaching, I taught in a very traditional sense. I would have the PowerPoint slides, I would have the graded homework, I would have the tests and exams in class so we can make sure everything is all above board and all that other fun stuff. And then as I go through, I think more and more back on what was important when I was working, and how that work environment operated. I now have moved as far away from trying to test as minimally as possible, if not never, and do much more project-based learning because that’s what I did. And even when I give a test, I would give a two-fold piece of the test. The first bullet piece is the closed book portion, which never ever had a calculation in it. And I told my students, when I was at a meeting, I was there as a knowledge source. And so I’d have to know somethings off the top of my head. That’s what they paid me the money for . And then if they asked me a question about X, Y, or Z, that had to have some calculations based into it, we’ve never had to do it right there on the table. That was not something you did. You could go back to your office, you could use all your resources, you could pull together the things you needed for that project. And so I tried now to model my classroom along those points, I will tell them, these are the things you need to know off the top of your head, this is the stuff that they’re going to pay you for that boom, boom, boom, you need to know. But everything else, Google is your friend, having your textbook there is your friend. And so on any of that stuff it’s open book, open notes. It’s a little harder with AI now. I’m not going to lie. But still, in general, if I was in industry, that would probably be where I would start as well. Oh, I need to do this. Okay, “Hey Google blah, blah, blah, blah, blah.” There’s my starting point. Now let’s move on forward.

Kevin: I think two things. So I spent the 32 years that I was at IBM, I spent one year doing microprocessor design and the other 31 years, I was in software development. And I’m a big believer in soft skills. And some of that comes from also being an ex-Scoutmaster, and heavily involved in scouting. But I tell my students, I try to instill in them the idea that your communication skills are vital to your advancement in your career. Everybody can code, but as you advance in your career, as you go further up the ladder, you’ll have larger responsibilities and you have more communication responsibilities, till you reach a certain point in which you live from being as technical toward being more in terms of communication. But one of the last things I worked on was I was basically project managing the, what they call the enablement for a test site, which is to say, just getting all the pieces together to build an experimental chip and a new technology. And that was primarily a communication job, it was a project management kind of thing. The other thing is the importance of group work and project work. And being able to work with other people that those, I think, as well as for my computer science students, algorithms really do matter. And anybody can write code that slow. But it’s important that you understand enough of the algorithms. And that’s because I entered industry as an electrical engineer, I had no background in any of those things. And I wrote some spectacularly bad code, when I was back in my 20s, before I started taking some graduate courses and going, “Oh, wow, there’s a better way to do this.” And so those are kind of the things that I think are important.

Mike: I want to piggyback on the group work part, I do a lot of group work as well. And one of the things I tell my students because I will always get the “Well, I’m the strongest person on this team, I’m doing all the work.” And I go to a “Yeah, congratulations. I said there was never a project that was less than $20,000 I worked on by myself. You’re always part of a team, you’re never a loan problem solver, if there’s money involved, because they want the others to be part of it and keep track of it and make sure it happens as fast as possible.” So group work where sometimes we let them off because of the whole stigma of “I’m going to be the only person working on it. Everybody is going to be a hanger on.” Well, when you get paid, that’s going to happen too and all you have to do is smile and say, “Yay, thank you,” and keep going [LAUGHTER] because you’re getting paid to do the thing.

Kevin: But I’ll just add that there’s no industry group I’ve ever worked on, where there weren’t checkpoints and communication of where things were. And so I know Mike does a lot of these kinds of things as well, which is the idea that what happened when we were undergrads where they basically say, “alright, you’re in a group, go do this, and then deliver the product.” So even in student groups, the importance of having checkpoints, and I basically have them write progress reports like you would do in industry along the way. It’s not “Here’s the project, go do it. Now here’s an end result.” It’s more like “Okay, you’ve gone for a week. What has each person done? What’s your next step?” Those kinds of things.

Mike: And while we’re trying to develop these skills for students going into industry, we think that there… well, I say, and probably Kevin will agree, they’re important no matter where you’re going to go into, including academia or any of the other spots. So I don’t want to make it sound like we’re trying to educate students just to go into a particular engineering job. But this is more of a realistic facet of life in general.

Rebecca: Do you think you both would have found this same path in teaching had you not had the industry experience and kind of underscoring and value some of the same things that you do now?

Mike: Absolutely not. You like what you’ve seen, and so we would have seen “sage on the stage,” and that is what we’d do. And to a point, that’s where we all start, right? I mean, there’s that sage on the stage piece, and then you start saying, “Okay, there’s got to be something better, because I’m not reaching all my students.” So how can I do that with the knowledge that you never will reach all of your students, but you got to give it the best bet you can.

Kevin: I think when I started, one of the big differences was the deference that people showed, it’s like, “Oh, you’re a faculty member, oh…”, and I worry, actually, if I had been 28, and started teaching at that point, that that would have gone to my head, and I would have started to believe my own PR. I don’t see people around me with that problem, but kind of a stereotype of academia. And you do read stories about actual faculty who are like that. But working in industry can give you a good strong sense of humility, because you have successes, and you have failures along the way.

Mike: So I will say in industry, there was still some of that out there. I mean, I used to get emails from my PhD colleagues down in Painted post, who would talk down to me because I was at a plant saying, “Oh, let me explain this to you in very simple terms.” In the very next email, I would just respond. “Well, thank you so much for your guided steps. Dr. Michael Walters, PhD da da da da da.” it was amazing. The next email was much more as an equal instead of I will talk down to you because you are way out there in the hinterlands. Do you know how to rub two sticks together to get fired, because you might need that you’re in the cold part of the country.

John: That reminds me of a time when I was coaching soccer for my sons’ teams. And there was another child who was on the same team three or four times over a space of four or five years. And there was an article that mentioned me in a local newspaper, and this mother came up to me and said, “Well, I knew you worked at the college, but I assumed you were a janitor there.” It was an interesting experience, because she always saw me out there in sweatpants and t-shirts and just assumed “Well, that’s not how a professor looks.” I think maybe that attitude is more common in elite private institutions, Ivy League, and so forth. I don’t think I’ve seen it at Oswego, which is very much like Plattsburgh, in terms of being a four-year comprehensive college.

Kevin: Well, if you wanted to, you could have coached in the tweed jacket with the elbow patches, and then they’d have all known.

Mike: And a pipe, you gotta have the pipe. You don’t have to put anything in the pipe, because that’s bad. But just the pipe itself.

John: I actually had one of those sports jackets. And it was a running joke with some of my students back in the 1980s, [LAUGHTER] because I just had that one sports jacket, and I wore it whenever there were honors, awards, and so forth. And they still ask me about it 35 years later. [LAUGHTER] But you know, one of the things I’m hearing from both of you is that you’re both doing some authentic assessments, which is something that we’re trying to encourage faculty to do in general, to move beyond the traditional types of teaching. How do you find that students react to these types of group projects or the teamwork or other things that you’re having them do?

Kevin: I’ve had, I think, a lot of success with it. I can’t think of any really bad experiences. Mike’s nodding his head. But I have a poster actually coming up at CCSCNE on our tech startup class, that actually, Dr. Del Hart, our department chair, the person who kind of came up with this idea, and then he came to me and he said, “So you’ve worked in industry, and you’ve been a Scoutmaster, how would you like to try leading this class, and it’s a multi-level multi-semester class where students basically can take on different roles based on whether they’re 400, 300, or 200 level in the class, and projects can run for multiple semesters?” And it’s probably one of the most fun classes I’ve ever taught. Because a lot of times I found myself, I don’t teach it now, but I found myself actually telling them “Slow down a little bit. Let’s establish some realistic goals. I know you’re very excited about what you want to do here.” But I think generally, I find the project work goes really well. But I do try really hard to make sure that I’m aware of what they think is going on with their team through various assignments that I collect that are like reflections or statuses.

Mike: I’ve had overall success. There have been times where there’s been failures, one or two semi spectacularly. We do a intermediate robotics lab, which is a project-based group class and at the beginning of the semester I give them what I call a 90% google-able project and say “Okay, from here on out, your group is now doing this for the rest of the semester. If you get done with part A, there is a part B you can have as a stretch goal if you want, but this is what you need to do.” And I try to emphasize that failure still means you can get an A, it just means that you failed at trying to get the project to work. The 10% is the hardest part of the whole project for any of these projects. Working for Corning, I was working on the bleeding edge of technology. And so I was always a horrible person till then in saying how long it’s gonna take to do something because I’ll say “it takes two weeks,” because it looks simple. And at the end of the two weeks, my boss would come back to me, “How’s that going?”” I got the first step kind of done.”” What do you mean kind of done?” “We’re still inventing something brand new, it didn’t happen as fast as I was hoping.” So when the project does work, this 90% thing, it’s great to see the students get excited, they see progress, they keep moving. And then what’s funny is then the cockiness will come out and say we can get this done in that three weeks, I’m like, “Yep, you’re just like me, we’ll see you at the end of the semester.” And sure enough, [LAUGHTER] that’s when it’ll happen, because they’ll run into wall after wall after wall because that last 10% is hard. But I do get sometimes, like this past semester, where the project I picked ended up being a failure. By the end of the semester, it did not work the way it was supposed to work, they could not get the robot to do the thing. And you can tell that towards the end, they were getting really down. I mean, really, really down. And at our final session where we basically talked about what worked and what didn’t work for the project, basically, I told them, “This is what happens probably 25 to 50% of the time in industry. You’re going to work on a project, work on a project, and it’s not going to work.” And there’s times when you got to sit down and say why doesn’t this work? And then go to your boss and say, “Well, you either a didn’t give us enough information, or enough resources or a combination of the two.” And I told them, “I didn’t give them enough resources to make it happen.” But we got to this point. So I pumped them up like, “Here’s the teamwork that you did, this is all great.” And they all got their “A” because every single person contributed and worked towards it. But those failures can sometimes be problematic. On the flip side of it, doing so much non-assessing means I go ahead and give them a lot of homework assignments that once again, are graded basically, “did you hand it in?” Did it kind of do the thing was supposed to do? Yay, you get all the points. And what’s funny is I thought this semester where I cut up all my tests. I have no test this semester whatsoever. Everything is you have homework, classwork, and a project. That’s it. And the beginning of semester, I was nervous. I was like, how am I going to differentiate? Not that I care. If all the students get As I’m happy. But I just want to know if I had to differentiate, how am I going to do the differentiation based on the system? Well, my students have proven to me that they can self select, because they stopped doing assignments. So they stopped doing whatever. And it’s like, “okay, this is how self selection will work.” It’s not that I don’t even come to them, say, “by the way, you haven’t handled this in…” “yeah, I’ll get to it.” We’re human, they’re not going to get to it. And that’s fine, too. But it ends up being almost more psychological of “You didn’t prove to me, not only that you didn’t know the material, but you also showed that you didn’t have the discipline to get that piece done.” And whether that is the focus of my class or not, I don’t know. That’s the negative to this type of assessment. I can’t tell if it’s because they didn’t know the material. So therefore, they didn’t feel comfortable trying to finish the assignment, or whether life happened. And that’s the only negative I’ve seen so far about using this assessment, because you see them not be so stressed, because there’s a test coming up and not be so focused “I’ve got to cram this thing together,” then five minutes later don’t know a single thing when you go talk to me in the hallway about what I put on the piece of paper.

Kevin: It’s funny in that class that I started by actually did something that would be called ungrading. And I used something I’d found in an article years ago, I could find the reference if I had to, but it was how Intel assessed people is managers would come in initially with a sheaf of overhead slides, then they’d have “this person should be promoted.” And you look at it’s here slide 1 of 60 kind of thing. And they went to this thing, I think they call it three up, three down, where you had to give three positive and three negative for the person and then summarize. And I actually had my students in that class for their midterm and their final grade, they had to do those. They had to do a self assessment, they had to tell me three things they were proud of, three things they could have done better or they didn’t do well, what they thought their final grade shouldn’t be and why. That class, though, that was a pretty much a highly selective class, that it was very, very seldom that a student checked out. And part of that was because the person in charge of their project was the 400 level student who they had agreed to work on that project with. And so there was a lot of peer interaction that led to just generally, I think, really good outcomes. Dr. Lecky’s teaching the class now, and from what I hear, he’s having a very similar experience with that course sequence.

John: One of the things we’re doing right now, and I know Kevin, you’ve already been participating in this, is a reading group on Grading for Growth by Robert Talbert and David Clark. And one of the points they make in their book is that, while we’re so used to traditional grading because we grew up with it, and that’s what we’ve always done in some way, one issue is the only time people tend to be graded this way is in academia, when they’re working in industry, they’re reviewed, but they don’t get grades, they either meet the requirements or they don’t, or if they exceed them, there are chances of promotion and so forth. But in pretty much everything else, including our own careers, we get renewed, we get tenure at some point, and there may be some other additional pay increases based on how well you’ve done. But we don’t get letter grades. And we don’t get numeric grades every year. And one of the things I’m noticing is you’re both doing some types of grading that are closer to the types of experience that you’d find in industry. Do you think that made you perhaps more willing to try these types of things that a lot of faculty have been really reluctant to experiment with?

Mike: I think so. When we talk about the industry thing it brought back a story, I one time was in a review, and I was rather well paid at this plant. And so they had high expectations for the salary they were paying me. I remember, I was talking to the plant managing engineer and they even brought the plant manager in during my review. So either this was gonna be a really good thing or a really bad thing. When I walk into the room. It’s like, okay, which way is this gonna go? I thought it was a bad thing. But what’s funny was they gave me a “met expectations.” But the plant manager turned to me he and he goes “I expected you to “exceed expectations.” I’m like, “Well, how am I supposed to exceed expectations? By default, you’re saying that is your expectation. So therefore, I either met the expectation or I didn’t.” And we got into a heated verbal argument for a little while. And eventually, I said, “Look, you either give me met expectations, or I didn’t meet expectations, I don’t care. But what you just said makes no sense.” And she threw up her hands and left, and I got “met expectations.” But it was just one of those things. It’s like even using these types of methodologies, sometimes you get conflicting viewpoints that goes forward. As to what your question asks, yeah, I think with the industry, this is why I’m gravitated towards that. I teach a class called fundamentals of engineering design. And when I tell the students why this class is there, I said, it’s everything I wish I knew as an engineer, before I became one. I was a physicist, I didn’t go through any of these preparatory courses, and then boom, here’s an engineering role, go run with it. And so being able to help my students be in a better situation when they go out into industry, which I assume most of my students are going to do, is a good thing. And any of the skills they pick up because of this isn’t bad if they stay in academia. Maybe this helps break the cycle of, we only can test and do homework for grades. By the way, I’m just gonna throw out my pet peeve for all of you out there listening. My biggest pet peeve is if you grade homework like a test, and count it, where are the students supposed to make the mistakes? That’s the thing that always used to tick me off. Where do I practice and get legitimate feedback on my practice, to know where I’m making a mistake such that when I go ahead and then perform, I know I’m performing at a higher level. That part always bothered me when I was an undergraduate. That was from day one, when I started adjuncting, I said, I’m not going to do that. Homework is going to be: did you try it or did you not try it, period, That’s it.

Kevin: I’m gonna make just one little thing. IBM really, really tried very hard for a long time to just grade people. We had a system where you had an appraisal or a personal business commitment. And at the end of the year, your manager basically gave you a score from one to five. The system changed many times over my years, but: one was, you’re on track, we’re going to promote you, you’re doing awesome, and a five was it was nice knowing you, but you generally knew where you were going to fall. And I won’t get into all of the arguments over the years as to whether there were ratios or stacked ranking, and at what level in the organization, there was a quota on how many could be at each thing. Actually, those kinds of systems caused a lot of the negativity that made me think that maybe I wanted to go to teach. I think, for me, one of the really big things has been, as soon as I started teaching, I started trying to learn how to teach, because I walked in the door, I adjuncted for one class at the University of Vermont, it was a graduate-level course and I really enjoyed it, and it was great. But I realized how much I didn’t know about teaching. I had my teaching statement when I applied for the job, actually leaned really, really heavily on stuff I’d learned as a boy scout leader, and then like a leadership course called wood badge, a six day leadership program. And I had learned a lot of what was basically active learning as part of that program, something called the edge method: Explain, Demonstrate, Guide, Enable sort of thing. And so I had kind of this foundation that came from a very non-traditional place in terms of pedagogy. And I came in and I started out doing exactly what I had experienced, which was you stand up, you lecture, you use PowerPoint, it’s really cool, you give homeworks but at the same time I started reading stuff and a lot of it was James Lang’s books. I think I’ve read all of his books, because the first one I read was On Course, and I think that they should give every new faculty member a copy of that book during orientation, because it got me through my first year. I have a copy in my office that I think has got a thousand post it notes stuck in it. And then I started reading his other books. And then I started reading the books he was talking about. And these days, I love to teach my classes in our programming lab, because when I can, it takes more prep time, but it makes actually the class easier for me in a lot of ways to do a little bit of lecturing and then say, “Okay, now you get the computer in front of you, go make JavaScript to do this.” And I’m going to walk around the room and help you do it. And so you’re kind of turning even lecture sections into labs, in that sense. And I find that’s a lot of fun for me. And I think the students find it more interesting, because some of them kind of struggle. But the thing is, there’s me, and there’s the other students around them. Like when I give quizzes, now I hand out a quiz, I say, “Take about 10 minutes and work on this.” And I say, “Okay, now compare your notes with your neighbors.” And then I say, “alright, let’s discuss it.” And at the end, I collect it, and basically say, “There you go, you get credit for being here, because you did this.” And I have a couple of students and Mike would know their names, I won’t mention them, they sit there, and when I give him one of these things, they’re way beyond anything I’ve even envisioned, they’ve gone off. But other students, I have to sit with them and help them. And I just find that’s a lot more satisfying for me as a teacher than to stand at a whiteboard and scribble on it for 50 minutes, or mine are all an hour and 15 minutes this way I set my schedule up.

Mike: I’ll agree with that, and I’m actually moving more and more of my courses over to, I will give you the bare minimum that you need to do what I’m about to ask you to do, and then go do this thing. And practice it there. And I’ll walk around, I’ll help out, we’ll talk to everybody, make it much more of a laboratory class, even though it’s not a laboratory class, just because the interaction between their peers, their interaction with me, becomes more of a one on one instead of one on many. Way back when, I used to start off my class, when I would teach introductory physics with saying, “You could learn from the book everything I’m about to show you, and that’d be great. And if you never show up and just show up for the test, you could do that. Awesome, congratulations, we’ll see these dates and have a great time. I know. But if you come here and just listen to me, that gives you the book and me. But here’s the more important thing, look around the room, there’s 40 other people here. So that’s me, 39 other people and you. All of a sudden you have lots of teachers that could work with you. And as long as I help facilitate you being able to use that resource, you have many, many more options, because I might not have the analogy you need. But your friend next to you or the one over two rows from you might have that analogy you need to make that connection.”

John: Could you each share some of your favorite teaching activities that you use in your classes?

Mike: I’m trying to teach them brainstorming methods, especially technical brainstorming. I have 1 2 3 4 5 6 whiteboards in my room. And I’m going to ask in front of each whiteboard, “I want three technologies, just random three technologies.” I’ll keep writing them down without telling them what’s happening, three technologies on every whiteboard. And then I break them up into groups and give them each one color markers. They always use their color marker and say, “Okay, now the six groups go to each of your boards, you now have two minutes to write every single technology product you can come up with, that’s a combination of some sort, matter, or form of those three technologies.” And sometimes like it could be weird stuff like ice cream, rocketry, and such and such, and I’m like, “Yep, now you got to figure out how you’re going to combine those three.” And I tell them, “Okay, so if you’re the first person on the board, you’re gonna put a one next to your thing, you only get one point for every one you come up with. Then you’re gonna draw a line and the next group comes up, they get two points per thing they come up with, they can’t come up with something that you already have, all the way up to that final group, where now five of the groups that brainstormed, but everything you come up with now is worth six points.” So it’s like you get one or two things you just made up for your first board and second board without a problem. But it really shows them, sometimes those six pointers at the end, when you’re really just grasping at straws, become the things that you want to move forward on. It goes to writing even. So I know when I do my writing, it’s like that first draft, you did all the easy stuff. Now throw out all the easy stuff, and I’ll start putting the second and third order stuff that might make it much more interesting.

Rebecca: That’s a great exercise. It’s really hard to get students to get to that further step. They want to stop at step one or two.

Mike: Oh exactly, and making it a competition of which team can get the most points, get some of them, their juices flowing. And it’ll be funny because at the end, we go through everybody’s stuff like “is this a legitimate idea?” No, cross it off. Then it doesn’t count. That’s a group response of rating, basically, of the thing. And it’s funny because at the end, most of the time, I can’t get through all six boards by the end, and they’ll be sitting there going: “We got to finish this. I want to know who won.”

Kevin: …favorite teaching activities. I really do like and I do it a lot now, which is to give the students little coding challenges in C++ or JavaScript class, which is to basically hand out something that looks like a quiz, but it’s basically: here’s some coding, let’s do do this simple coding thing in class, because if I handed out as a homework, well, they could try using ChatGPT. Although I have to at some point talk with Mike about the fact that one of my students tried that and ChatGPT hallucinated a library for circuit Python that doesn’t exist. And as I said, on social media to my friends, I’m happy to set up a PayPal account, if ChatGPT wants to hire me as a consultant to debug their program’s mistakes, because the poor student had no idea what to do, because the code he was given was incomprehensible. But I really like giving the students an exercise to do in class. The second place I would say, was, when I taught our ethics course, I did a lot of debates in class. And sometimes I would let them self select what side they wanted to be on the issue like drone warfare things, other times, I would kind of assign them. And when they balk at that, I’d kind of lean hard into my own experience and say, “Well, you know, I debated in high school, and you didn’t get to choose what side you were on. And it helps sharpen your brain to argue something that you don’t necessarily agree with, to try to logically follow it.” I would say for in classroom, those would be for out of classroom, like project kind of things, the posters, having students do a poster session, at the end of the semester, actually printing the posters, and putting them up in the lobby of our building. And then having kind of a little session where people can walk around, just like a conference poster session.

Rebecca: it’s really great to hear the different ways that both of you have incorporated your industry experience into the classroom from changing grading systems to thinking about consistent feedback throughout the semester so that students can learn and always being on that verge of not quite knowing what’s coming next, like you are often when you’re in a tech field and having to constantly learn or have professional development or try things that are brand new to you. But we always wrap up by asking: “what’s next?”

Kevin: I am, as the phrase goes, playing with house money. I was at IBM for 32 years, my wife still works there. I continue to do this because I really enjoy it. And I love all three aspects of the job in academia, I love the research, which we do research, I think I would say with a small r,, not like R1 with a capital R. I love the research, I really liked the service. All that time I did at IBM, I can do committees like you wouldn’t believe. I know how to do that kind of stuff. And I know how to be helpful in that way. And I love the teaching. I mean, I’m teaching an honors seminar on algorithmic bias this fall that I’ve taught once before. I really enjoy teaching a new class every once in a while or creating a class. It’s a very intellectually stimulating field. And I’ll just do it until my wife and I decide it’s time to be able to go to Disney World in September or something. And my guess is that a few years down the road, I’ll probably retire. And I will continue to adjunct because the great thing about adjuncting is you can keep an email address and you can also still get discounts on software. [LAUGHTER] I kid you not. It’s kind of like “Hey, I’ve got all of the Adobe tools and I was playing with Dreamweaver for my JavaScript class and generative AI creating images the other day.” I’m so curiosity driven that continuing to teach as long as I’m enjoying it.

Mike: My “what’s next” is to try to become a better evangelizer for the robotics major here at Plattsburgh. We’ve been growing it slowly, and I firmly believe in what opportunities it allows people to have it going towards the future. I run a not for profit here in Plattsburgh that works with middle schoolers and high schoolers to give them robotics opportunities on Saturdays. I do this major, I’m chair just so I can make sure I have the time to devote to doing things. It is fun, starting something and watching it grow up. And I’m just having a ball with it. All the stresses and anxiety that come with that as well. But yeah, that’s my what’s next.

John: And going back to Kevin’s comment, before you make the decision to go to Disney World in September. If you start teaching online or doing some more work teaching online, there is the Online Learning Consortium, which has a conference at Disney World in November, which is a really great time to leave the Northeast. And it’s a four-day conference, but you get the special conference rates at the hotel for a couple of days before and a couple of days after. So you might be able to combine those things.

Kevin: I will have to look into that because the best conference I ever went to is Design Automation Conference, it was held at the San Diego Convention Center and I went to that a couple times for IBM for CAD software and it’s one of those 6000-person trade show conferences, top end technical conference and on the trade show floor, everybody’s collecting polo shirts and desk-y gadgets, that kind of thing. It can be a lot of fun. And I have stories about that that are actually very funny as well, because when you’re at one of those and the part of the company you work for actually competes with many of the companies you’re visiting, eventually they kind of figure out that you’re asking questions that an ordinary customer would not ask. [LAUGHTER] And they’re kind of like, what exactly do you do for them?

Rebecca: Well, thank you so much for joining us. It was great to get a chance to talk to you in more depth.

Kevin: This was fun.

Mike: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

338. Diversifying the Education Pipeline

Diversifying various fields and disciplines requires intentional work to create and support a pipeline of practitioners. In this episode, Laura Spenceley joins us to discuss specific initiatives to increase inclusion in the PK-12 sector. Laura is the Dean of the School of Education here at SUNY Oswego. She is an Impact Academy Fellow through the national non-profit organization Deans for Impact which works to strengthen and diversify the educator workforce.

Transcript

John: Diversifying various fields and disciplines requires intentional work to create and support a pipeline of practitioners. In this episode, we talk about specific initiatives to increase inclusion in the PK-12 sector

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Laura Spenceley. Laura is the Dean of the School of Education here at SUNY Oswego. She is an Impact Academy Fellow through the national non-profit organization Deans for Impact which works to strengthen and diversify the educator workforce. Welcome, Laura.

Laura: So great to be with you two today. I’m really excited for our conversation.

John: It’s overdue. We’re really happy to be talking to you today. And we’re talking to you from a new room which the School of Education has graciously loaned to us because we lost our old recording space, and we’re now able to keep the podcast going. So thank you.

Laura: You’re most welcome. And truly, I can’t think of a more symbiotic relationship between Tea for Teaching, the opportunity to host you here in the School of Education, and continue this great work and digging into pedagogy issues across the education continuum. And having you right here in-house makes a lot of sense.

John: Our teas today are:… Laura, are you drinking any tea?

Laura: I am not a tea drinker. But I do have a robust French roast in my mug today.

Rebecca: A popular flavor of tea, as we’ve noted multiple times here on the podcast. I have Hunan Jig today, John, I thought it was a good celebratory sounding tea.

John: And I have a spring cherry green tea in a brand new School of Education mug, which I just received today. Thank you.

Laura: You’re welcome.

Rebecca: In your role as the Dean of the School of Education, you’re involved in the entire P-20 pathway. The School of Education has received two large grants to help support students pursuing careers in education. Could you tell us a little bit about these grants?

Laura: I’m thrilled to talk more about these opportunities. And these two projects are our teacher opportunity core grant, that’s our TOC grant and our Cultivating Representation in School Psychology grant. Both of these grants are, as their name may imply, designed to help us recruit, support, retain and move through into careers, teachers and school psychologists from a wide range of backgrounds. It’s a well known fact across most educational spaces that folks who are delivering instruction or providing support services don’t always represent the constituent student populations with whom they work. And each of these programs are designed to 1. help ensure that we have a representative and diverse education workforce. But more importantly than that, they’re also designed to ensure that as we recruit and matriculate students into our teacher preparation programs and school psychology program, that we’re investing in those candidates along the way, recognizing that students from historically marginalized groups are often more likely to have challenges in persisting through their academic programs, both undergraduate and graduate. So each of these programs has some similar foundational elements. That includes financial support along the continuum of their educational program, again, undergraduate or graduate, support for things like transportation, professional development opportunities. And those professional development opportunities are really designed to empower our students from those historically marginalized or underrepresented spaces in their fields with contemporary activities that will help them address systemic discrepancies in schools. So making classrooms more responsive to the needs of the multicultural communities in which they reside, helping ensure that our future psychologists and educators have opportunities to work with people along the way that look like them, that share their lived experiences, and build that really continuum of care around their success. It’s also a great opportunity for us as educators, leaders, teachers, to be invested in those spaces with them and hearing from their mouths, what their challenges are, what their opportunities are in districts and really working to empower them for a career in education.

John: And the School of Education has always been engaged in working with students from all these marginalized groups that you’ve mentioned. What other types of support, though, have you been working on developing in the School of Ed for students who are first-gen students, Pell-eligible students, or from historically minoritized groups?

Laura: It’s a great question, John, and I’m so thankful to have the opportunity to chat about it because I think sometimes, as is human nature, we want to create responses or programming from a perspective of “all first gen-students might need this thing” or “all Pell-eligible students might need this thing” and we’ve been certainly sensitive to the realities that those populations experience, but also have tried to take a step back and take a more nuanced approach to that work. I’ve had the opportunity to be in the Dean’s position for about three years now. And when I came in the door, it was the year after the global pandemic. And so, so much of what we knew here on a college campus and in our P-12 spaces in the community had just been turned on its head. So when I came into the dean’s office, one of the things that was really important was to hear from our students, our candidates pursuing their degrees, what are the challenges that you’re experiencing? And I need to give a shout out to Dr. Nicole Brown, our director of our clinical practice and partnerships office, she really had this vision of surveying students, engaging in some listening sessions with those students. And we took the opportunity to deploy a survey about how students were experiencing their programs, but also the challenges that they were experiencing. And those data were humbling, to say the least. We learned back in 2021-22, about one in five of our students was having to make the choice between eating and paying for gas to get to their placements. About one in four of our students had to go without a meal at a certain point so that they would be able to engage. We recognize, and this was not a new problem, but just how challenging transportation to and from their clinical sites was becoming particularly in a time where we were very sensitive to being in enclosed spaces. And so we took that opportunity to reflect on the ways we weren’t just to use quotes, “utilizing the resources,” like our teacher opportunity core program, but to really recalibrate the way we were engaging with all students. And so what that looks like right now is we’ve really taken an approach to engage with our students from the time they’re prospective students all the way through graduation and career placement. And so what that has looked like is we’ve had active faculty and administrator presence at recruitment events, helping prospective students and their families understand not just the phenomenal financial aid resources available to them, but demystifying grant programs like the Teach Grant program, like public service loan forgiveness, which is available to many of our graduates after a period of time, it’s also about helping those families understand what contemporary classrooms and contemporary educational careers look like. There’s so much animus in public media and in the dialogue around what’s going on in schools and giving our prospective students the opportunity to hear from our current students and our partners, what they can actually expect, not just out of their degree program, but the field, has been really impactful. On a more nuanced level, as a result of that survey, we have utilized a range of resources to help offset some of those specific concerns regarding transportation, costs related to certification, and food instability. I do need to call out our amazing student affairs team on campus that has made enormous investments in this space as well. And I think always connecting students to the most local resources has been a really effective way to ensure they can take advantage of those supports in a way that makes sense to them. For us, I was lucky enough to inherit a 12-passenger van that had been purchased right before the pandemic, and we’ve taken the opportunity to hire student drivers. We offer daily routes to and from the Syracuse area at no cost to our students, leveraging the generosity of our alumni and donors who have invested in the School of Education, we have made a commitment for any candidate that needs to get to or from their site and can’t use the van, that we’ve created an Uber voucher system. And so we’ve been able to put those funds directly in front of students. We’ve expanded our supports for certification exams and fingerprinting through really simply asking students: “Are these barriers?” and creating a process again, through our foundation funds, that we’ve been able to offset those costs in time of need. And then lastly, I think another part of this is helping our faculty understand the realities that our candidates are experiencing as they move through their degree programs. Bringing those data back from not just the survey but listening sessions we continue to offer as an open forum for students to share their concerns, bringing that back to our faculty and helping them understand in both a formative and accurate sort of way, what the experiences of our students are in looking to make changes, whether it’s to our core sequences, the way that we administer fees, encouraging open-access resources, building resource libraries within our departments, so that we can continue to wrap our arms around students, give them a great experience, and also ensure that something like a meal isn’t getting in the way of their ability to get to and from their site.

John: And one thing we should note is that Syracuse is about 40 miles or so from here. So the commute time for a student would probably be about 45 minutes to 55 minutes, depending on where the school is located. So transportation would be relatively expensive for students.

Laura: Yes, and it’s such a good point to make, and I know we’re likely to talk about partnerships later, being where we are here in Oswego, we are lucky enough to have amazing partners along the I-81 corridor from Syracuse to Oswego, almost to Utica, almost to Rochester. And so it is not unusual that our candidates are driving up to an hour each way. So absolutely.

Rebecca: And it’s a problem that campuses that are in a more rural context experience when they’re doing any kind of placements, whether it’s internships, student teaching, or service learning, or anything like that. It’s very different than an urban context.

Laura: Absolutely. And I think we’re really committed, we embrace the idea that we are a rural educator preparation program, while also embracing the fact we have large urban partners just down the road. And we see that as an opportunity to diversify our candidates’ experience and give them a broad sampling of school structures, organizations, what’s possible, both in large districts, small and the in-betweens. And so that’s been a really critical part of our preparation framework for many, many years here in the School of Education.

Rebecca: It’s always great to hear stories, and we’ve heard more of these since COVID, of schools really paying attention to the actual needs of students and what barriers they’re facing, and really being responsive to them and finding ways to solve the barriers that they’re facing. Because often, the barriers are great, but often there are solutions that we can put into place that aren’t actually that complicated when we get down to what they are.

Laura: Rebecca, I love so much how you framed that, because one of the driving mantras that I often remind myself is we can solve problems if we choose to. And I think to solve problems, we need to be able to describe the problem, we need to understand it from a compassionate perspective. Recognizing every candidate that declares a School of Ed major sees themselves as a future educator in one form or another, and partnering with them, to actualize that vision is the best part of my job.

Rebecca: Well, and we would hope they want to do the same thing for their students. So modeling what we’re hoping to bring into the land of education is certainly a good place to be. We talked before COVID, with the School of Education about some of the really great partnerships you all have both locally and regionally, both as school districts and community organizations. Can you talk a little bit more about some of the outreach you’re continuing to do in those spaces?

Laura: Absolutely. And frankly, we would not be a school of education without partners. Every program housed within the School of Ed requires an applied learning experience. And so even our non-teacher preparation programs in counseling psychology and management programs require some sort of applied experience. And so strong relationships and a strong understanding of the context for our partners is really important to our success and our candidates’ success. So I’ll talk about a few examples since there are many day to day here in the School of Education. For context, in 2020-23, for example, we placed more than 1000 candidates across I believe 246 different settings, kindergarten all the way up through high school. Don’t quote me on the number, but I think I’m close. But we have made a couple of purposeful efforts over the last few years. And in particular around our professional development schools. These are schools where we have an agreement to focus professional development activities for our pre-service teachers, in-service teachers, so folks who are classroom teachers in that district, and align that with our faculty areas of expertise to create what are called that third space for learning, where we were bringing in a range of expertise and perspectives. Here in Oswego County, we have professional development school partnerships with six of our nine local districts. And those partnerships have focused on strengthening support for technology and STEM-oriented initiatives at the junior high and high school level. In another district, it’s included a dedicated focus on early elementary school literacy outcomes and improving the way we’re preparing kids to read and write. Other districts have focused on more systems-level change with strengthening the way that we identify students who are struggling before that becomes a significant impediment to their learning, and organizing teacher and leader responses to ensure that those processes are unbiased, that we’re making decisions that help us put resources around what kids need to thrive. But that’s just a sampling of the types of partnerships that we have with local districts. I think, given the fact that education continues to be a domain where the public dialogue is not always framed as positive, partnerships with our local practitioners and districts, give us opportunities to 1. change that narrative and help people in our communities understand the value that schools can bring to that community. And Rebecca, you mentioned the way that, coming through the pandemic, schools are really regarded as kind of community centers. And I think we’ve seen those types of initiatives be really effective, whether that is including opportunities for families to access medical care, dental care, social services and supports when they’re in district, we have something to offer to that conversation because of the range of our preparation programs here on campus. And so we really tried to engage with our partners in the P-12 sector to ensure that we are operating as a true continuum of care for our communities.

John: During the pandemic, there were some fairly substantial learning losses that disproportionately affected students from low-income households, and low-income school districts. And a study was just released by WICHE in February of 2024, which found that those learning losses are still persisting, which means the students who are teaching in schools are going to face students with a fairly wide variance in their prior preparation. What types of things do you do to help prepare students to address the diversity of student backgrounds in terms of how much they come into the classes with?

Laura: Coming through the pandemic, one of the things we were reminded of was the power of a direct positive relationship between a student and an adult in the building, that can look like a wide range of folks, coaches, teachers, mentors, administrators, volunteers. But that’s something we have continued to embed in our curriculum and helping our candidates understand that day to day, the way that we make students feel is often the thing that will be really critical and helping ensure that they walk through the door the next morning, the next day, or ask for help when they’re having a tough situation. And so empowering our students to respect the dignity of people’s lived experiences, we embed before they move into their clinical experiences in schools, quite a bit of reflection, self-reflection on their own lived experiences, what education has meant for them, the spaces where they have been privileged or perhaps oppressed through educational structures, protocols or policies, and building that capacity of our students to both identify and address bias or embedded bias in the spaces where they work. Getting down into the curricular focus, it is frankly staggering to see how children have been impacted, particularly in the early elementary levels and the older adolescence ages when we think about both academic skills, but socioemotional skills, wellbeing, and I think one of the things that I try to celebrate is the resilience that’s been built into this generation of learners. On the other hand, that comes with a certain amount of exhaustion, anxiety, uncertainty about their future, and so coming back to that element of relationship building, it’s so key. At the curricular level, there is an enormous focus here in New York on the ways that we can do a better job in preparing children to be literate, contributing members of a just society. So right now in New York, there’s a lot of focus on the science of reading. And I want to be really clear to listeners, the science of reading isn’t about a curriculum, it is about embracing the empirical evidence towards a systemic approach to the instruction of reading, writing, and literacy across grades. There’s an enormous amount of energy around this work right now recognizing that we can do better in preparing kids to be literate. And I’m starting to see an equal attention to a focus on math and frankly, STEM preparation. Here in our community in central New York industry has returned with a bang. And there are wonderful opportunities for employment for students with a wide range of educational experiences starting right out of high school for gainful and lifelong employment in these sectors. But what we’ve heard is that math proficiency is often a barrier for those students. And so trying to incorporate elements of curiosity and creativity, bringing science, technology, and math into creative spaces, like art, design, dance, helping students understand that math and science, quite frankly, isn’t just about memorizing equations, or knowing your multiplication tables. But there are a range of application of math, science in our day-to-day lives. When I think about when I was a kid, we had a great lesson on fractals, and we went outside and we found fractals in nature. I remember it to this day, almost like it was yesterday, trying to engage students in their learning, that incorporates their lived experiences, having access to textbooks, readings that reflect their family structures, their linguistic background, the realities of their lives. And so our students ,when they move into those first teaching positions, carrying with them that, I’ll go back to respect for the dignity of all persons, that recognition that kids carry much more with them into a classroom than a backpack, and finding ways that we can empower their learning not just through curriculum, but through curriculum that is delivered at their level, that celebrates individual students growth, that isn’t anchored in some specific outcome, but recognizes individual student’ s growth as meaningful. And I’m really proud to say our data suggests our students do move into their first teaching careers with those skills. And I think the next phase of the conversation starts to focus on how can we, as an educator preparation program, be part of the community in delivering professional development? How can we bring the great work that’s going on in schools to our faculty and have that kind of recursive flow of information, and also ensuring that we are preparing school leaders to create conditions that help us achieve all of these goals. And with our programming here in the School of Education, we’re uniquely positioned because we offer those range of preparation programs and have the luxury of great relationships with partners.

Rebecca: We’ve talked a little bit about learning losses in K-12. But obviously, that has an impact on our college students as well. They also survived the pandemic and are here. What are some of the things that your faculty are doing to help these candidates feel like they have what they need to go into the community having maybe had some experiences of remote learning or challenges with some of these subjects too?

Laura: This is a really important question. And I think it’s one I’ll both answer from the school of education perspective, but also the broader campus perspective, frankly, because we don’t do this work in a vacuum or in a silo. And so I’ll pick up on some of the elements of the last answer, which is making sure that we on campus are framing the opportunity to serve our students as a positive one. We have an opportunity to meet students where they are and that will look different for different students. On the other hand, I think our faculty have been eager to try to crack this code, so to speak, on bridging our lived experiences in K through 12 and transition to college through the framework of the contemporary student experience and those are not parallel for many of us or really even comparable. I have been trying to, as dean of the school, make sure that we are approaching this from a perspective of strength. What students do come to us with us is a resilience that students of prior generations may not have. They come to us with skills and knowledge of technology and how to leverage it in a way that students didn’t in the past. And frankly, it was because they had to learn how to use that technology. Students coming to our campus today have access to more information at their fingertips than any generation of student has ever had in the past. And where we have opportunities is to help students both identify where they may have gaps, whether in their knowledge or experience, put those experiences in front of our candidates, and also help them navigate this world where it’s not always easy to identify what is good information and bad information. Now, let’s drill into some more specific examples there. I think one of the most critical things that we have done in the last few years and again, I’ll give kudos where they’re due to our student orientation groups. We have been embedding ourselves into some of those opening week sessions, where we’ve had the opportunity to talk to our future majors and undeclared students around college- level expectations. And while that might sound silly, I think when students can hear from us, from me, from my faculty colleagues, our stories that many of us are first-gen, were Pell-eligible, have student loans, worked while we were in college, struggled to purchase textbooks, come from different backgrounds, are new to the state or the country. I think that goes a long way as a formative first step in building that trust in the relationship with our candidates. It also gives us the opportunity to begin to plant those seeds around what supports are available to them. Whether that is to help them address their mental and physical health needs, their academic needs through our tutoring center, our office of learning services, the embedded tutoring services, and also come to see us as people that are here to help support them and what their vision for their success looks like. I had a young person come up at the end of our first orientation and said, “I’ve never had someone like you say, you walked in the same path as I have.” And it was really a moment where I understood that coming to the table and being authentic with our students is so critical at this point. The other piece of it, John and Rebecca, is recalibrating the way that we orient our classrooms to continue to give students frameworks for utilizing technology and AI and the wide range of information, also helping them become critical consumers of that information, providing formative feedback to their assignments in real time, flipping our classrooms and allowing students to lead the conversation. I think providing choice as much as possible around what literature students choose to present in classes, for example, have been ways that we have said to students, both overtly and more discreetly, you matter, your story matters and you and my classroom matters. I’ll also share we have been taking a look at the way we offer our curriculum to try to identify, and again as part of a larger campus focus on retention and success for our first-year students, where are the pain points, so to speak, in their degree program, particularly for transfer students, we’ve heard that there isn’t always as seamless of a transition to campus as we may assume. And so really starting to tackle some changes in our course sequence to ensure that our academic programs are set up in a structured sequential way that also gives enough flexibility for students to pursue some of their areas of interest, be student athletes ,be club leaders, or frankly, support their family, which many of our students need to do.

John: Recently, we’ve seen a lot of attacks on education at all levels, with books being banned in the classroom, removed from libraries, and restrictions on the types of topics and the types of history that can be taught in classes. What are some of the things that you do in the School of Education to help prepare students for a world in which they may be facing more challenges from parents and political pressures?

Laura: This is a critically important question and will be critically important action. I hope I could say in the next year, but I have a feeling this will be a long road. Too often I hear colleagues, neighbors, friends say, “Well, Laura, at least we’re in New York, you don’t have to deal with this in the same way.” And while it is true, I am proud to be in a state that has been very overt about people’s lived experience, respecting the civil rights of all persons here in the state. It is also the case that that can change very quickly in an election cycle. And frankly, we have seen that across the country. I’m particularly concerned right now about the way that civil rights discussions have been framed. And there are some cases in litigation right now around bullying initiatives and carving out exclusions or exceptions in those bullying protocols or policies that would allow, for example, trans students to be targeted without recourse. We see that replicated in both sports spaces, but also classroom spaces. I’m deeply troubled that this is a place that we’re going in a country that was frankly built upon public education and access. And we haven’t always gotten that access piece right. Many of our school policies and procedures have been built on an exclusionary clause rather than an inclusionary mission. On the other hand, we’ve made such great gains over the last 10 to 20 years in ensuring that schools are more responsive, supportive, dignifying places. I’m really troubled by this work. For our students, we have a commitment to social justice embedded in the framework of the School of Education. And that is more than transactional or it goes beyond the words social justice. Our curriculum prior to students going into schools is focused on those ways that schools have been exclusive spaces, have not always dignified the realities of the people who walk through the doors. And so for our students, what we tried to do is help them understand the threats or attacks on people’s civil rights or their histories is not new. On the other hand, it’s taken a very different tone in the way that it’s being implemented. So 1., it’s giving them the tools in knowledge and understanding of history to understand schools don’t have to be exclusive places, schools can be responsive, welcoming, encouraging spaces for all students from all backgrounds. It’s also about helping students understand that I want to be a teacher, I don’t want to be a politician is not a reality in which they will live as an educator. We try to empower them without encouraging them to engage in any particular behavior, to stay attuned to the realities of how legislative efforts, school board votes, and other sorts of community oriented book bans and dialogues might impact their ability to teach a particular lesson, utilize a particular academic resource. So you may have seen coming out of Florida, among other things in the last few weeks, a school district teacher had thought that it was prudent to send home a permission slip to alert the parents, that their children were going to be exposed to a black author. It wasn’t about the content of the book, it was simply the fact that they were going to be reading a book from an African- American author. I can’t think of a better example to highlight the importance that an apolitical stance is not one that classroom teachers can take, that school leaders can take. And that’s not about voting for a particular person or a particular party. But it is standing up to ensure as educational experts who have preparation, expertise, and insights that the community may not, to share them and be vocal about the ways that diverse learning materials, accurate historical representations of the world are critical towards ensuring that we do not replicate them. And so I am both incredibly disheartened at the turn that this discourse has taken. I’m also incredibly optimistic when I look at how young people, how educators, how experts have shown up and linked arms to say: “This is not right. We are not going to correct the wrongs of our history by limiting access to that history or by building smaller tables with fewer voices.” And so I tried to stay in that headspace as much as possible.

Rebecca: Definitely some good reminders and things for all of us to be thinking about in our role as educators. So we always ramp up by asking what’s next?

Laura: I love that question, because I could probably read you a laundry list of the things that we’re thinking about in our School of Education. Right now, here in New York, there’s a lot of robust conversation around, what does a high-quality teacher look like? What are they ready to do in their classrooms? And there’s a lot of engagement there. And again, this relates to helping the public understand not just what we do day to day or what the outcomes are, but the opportunity space towards preparing children for lifetimes of success. Here in the School of Education, we’ve got a range of new programs that we’re lifting in the fall of 2024, including our new master’s degree in behavioral health and wellness. And frankly, I think we have a range of new programs. As we talked about industry thriving here in central New York. There’s also a lot of energy in the school of education around our career and technical educator preparation programs, and of course, our technology education programs, some great investments in our lab spaces, looking at opportunities to do more in partnership in and with local districts to ensure, as we were talking about kids across Oswego County, have great opportunities to engage with science and technology and math in ways that bring them out of the classroom and into the world and creative spaces. So I’m really excited to see what the year ahead is going to look like for us.

Rebecca: Well, thank you so much for joining us, Dean Spenceley and for our wonderful space.

John: …and we’ll be talking to you much more in the future.

Laura: I look forward to the opportunity. Thank you both.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

335. The Abundant University

The cost and the benefit of investing in a college education have been increasingly questioned outside of the academy. In this episode, Michael D. Smith joins us to discuss whether the traditional college model can survive in a world in which technological change has expanded the possibilities of  alternative education and credentialing mechanisms.

Michael is the J. Erik Jonnson Professor of Information Technology at Carnegie Mellon University’s Heinz College of Public Policy and Management and the author of The Abundant University: Remaking Higher Education for a Digital World. He is also a co-author of Streaming, Sharing, Stealing: Big Data and the Future of Entertainment.

Show Notes

Transcript

John: The cost and the benefit of investing in a college education have been increasingly questioned outside of the academy. In this episode, we discuss whether the traditional college model can survive in a world in which technological change has expanded the possibilities of alternative education and credentialing mechanisms.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Michael D. Smith. Michael is the J. Erik Jonnson Professor of Information Technology at Carnegie Mellon University’s Heinz College of Public Policy and Management and the author of The Abundant University: Remaking Higher Education for a Digital World. He is also a co-author of Streaming, Sharing, Stealing: Big Data and the Future of Entertainment. Welcome, Michael.

Michael: It’s great to be here, John, Rebecca. Thanks for having me so much.

John: We’re really pleased that you could join us. Today’s teas are:… Michael, are you drinking tea?

Michael: I did earlier today, my wife makes this lovely herbal tea that you put in a little strainer. So I still have that in my memory. [LAUGHTER]

Rebecca: I haven’t English breakfast. I was a little bit on the go today. [LAUGHTER]

John: An unusual circumstance that has only happened, I believe, once before… I also have English breakfast. So this is twice so far out of 330 some episodes, I think, that we’ve been drinking the same tea.

Rebecca: It’s rare. We’re not exactly the same, yeah. [LAUGHTER]

Michael: Alright, what are the odds?

John: 100% today? [LAUGHTER]

Rebecca: Yeah. [LAUGHTER] So we invited you here today, Michael,to discuss The Abundant University? You note that the current system of higher education was created in an environment in which educational institutions provided access to scarce educational resources to a privileged few and the perceived quality of colleges and universities was judged primarily by their selectivity. Can you explain the role that scarcity has long played in the structure of higher ed?

Michael: Yeah, so we created a system of higher education in a particular time and with a particular set of technologies. Specifically, you need to sit in my class, if you’re going to hear me, and I think both our expectations about privilege, and our technologies have changed in ways that mean that we desperately need to change how we deliver higher education. So one of the things I talk about in the book is just if you look at what defines power, what defines market power in the university, it comes from being able to control access to the scarce seats in your classroom, being able to control access to the scarce faculty experts, whatever the heck that means. And then being able to control access to who gets the credential, the highly valuable credential, that’s going to help you rise in the work world. I think those things are starting to change in ways that we in higher education ought to wake up to.

John: One example that you use to illustrate the issue of scarcity involves Joyce Carol Oates. Could you describe this example for our listeners?

Michael: Joyce Carol Oates is a great example. She’s an absolute rock star. She’s written 60 different novels, she’s won a National Book Award, O. Henry awards, she’s been nominated for the Pulitzer, all these wonderful things. And so you’d think we’d want to get as many students exposed to Joyce Carol Oates and her knowledge as possible. The problem is within the existing system, to get exposed to Joyce Carol Oates, you’ve got to get admitted to Princeton, which has an acceptance rate of like 4%, then you’ve got to be able to pay the tuition at Princeton, which is without aid, something like $80,000 a year. And then, even if you do those first two things, you’ve got to get up at five in the morning and stand in a long line of students to get access to one of the 10 seats in Joyce Carol Oates’s class. So we’re taking this incredibly valuable resource and we’re making it incredibly scarce. Could we do better? Well, we are in some sense, because Joyce Carol Oates has a class on the streaming service Masterclass, where for 15 bucks a month you can get access to Joyce Carol Oates’s knowledge. Now is it the same as what you get at Princeton? No, but it’s better than nothing. My daughter and I sat and took the class together, and it’s actually quite good. And that’s the contrast between scarcity and abundance I’m trying to draw out in the book. Are there ways we can use technology to make resources that used to be scarce, abundant in ways that could benefit students?

John: And that scarcity made a lot of sense when it was one lecturer sitting in a seminar room or in a lecture hall running a class and there was no way of distributing that information more widely. Things have changed a little bit since then, haven’t they?

Michael: They’ve changed a little bit and I talk about in the book, there’s something kind of odd about the way we define expertise in universities and the way we distribute that expertise. So to get tenure, I had to become the world’s recognized expert, whatever that means, in this incredibly narrow part of my discipline. So my value to the university is: I’m a specialist. And that’s great, except when I teach I teach like a generalist. I teach all these different topics where Erik Brynjolfsson is the expert or Catherine Tucker is the expert or Natalia Lavina or Ed McFowland. Wouldn’t it be cool if you could learn that topic from them? We’ve never been able to do that because it’s hard to bring them into the classroom. But now, we can create that sort of experience in ways that I think could really benefit our students. One of the examples I talked about in the book is Anita Elberse at Harvard Business School and I have both studied a particular area and we actually disagree, our conclusions disagree. When I teach it, I’m pretty sure I’m giving short shrift to Anita’s position. Wouldn’t it be cool if you could bring both of us into the classroom and I give my position she gives her position and the students decide for themselves. We’ve never been able to do that. I think we can now.

Rebecca: …really pointing to how technology is offering the opportunity for more inclusion. And that’s certainly been a topic that’s been happening throughout higher ed with Inclusive pedagogy and topics about UDL and digital accessibility and things like this. But you point to a number of structural barriers that impede this from actually happening in higher ed generally. Can you talk about these barriers and what it would take to make them go away?

Michael: Yeah, this was one of the hardest parts about writing this book is sort of taking a cold, honest look at our business model, for lack of a better word. And when I was giving this talk in front of a particular audience, and somebody said, “Mike, all the research shows…” and they were right… “all the research shows that the best way to become wealthy later in life is to get a four-year college degree from an elite school, and so we should be encouraging students to do that.” I’m like, “yes, and no, you’re absolutely right, the best way to become wealthy is to get a four-year college degree from an elite school. The problem is, the best way to get a four-year degree from an elite school is to be wealthy.” And when you add those two things together, we’ve created this terrible feedback loop that just exacerbates social inequality. Now, you might say, “Why do I say being wealthy is key to getting a four-year degree from an elite school?” And in the book, I talk a lot about some of Raj Chetty’s research, which shows that kids born in the top 1% of the income distribution have a one in four chance of getting admitted to an elite school, top 80 school, kids born in the bottom 20% of the income distribution have a one in 300 chance of getting admitted to the same elite school. And so what I say to my friends who are economists is, “Hey, I’m trained as an economist too, I believe in the efficient allocation of scarce resources. If we in higher education genuinely believe that rich kids just happen to be 77 times more likely to be capable of an elite education than the system’s working fine. But if we don’t believe that, and I don’t know anyone who does, then this is a terrible way, a terribly unjust way of allocating access to the scarce resource.” I don’t mean to pick on Princeton, but let me pick on Princeton since we talked about Joyce Carol Oates. Princeton admits more students from the top 0.1% of the income distribution… families making more than $2 million a year… than the combined number of students they admit from the bottom 20% of the income distribution… families making less than $25,000 a year. Is that because Princeton is biased against the poor? I don’t think so. I think it’s because all of our incentives encourage us to make decisions that are highly correlated with wealth. And I could expand on that if you want, but one example I think a lot about and talk in the book about is Georgia State University in 2009, made some very intentional efforts to increase access to their campus, they ended up increasing the number of Pell-eligible students that they admitted from 32% to 60%, which meant they had three times more Pell-eligible students at Georgia State University than the entire Ivy League combined. So great news for access and inclusivity. The only problem is by doing that, they dropped 30 places in the US News and World Report rankings because their SATs scores, their alumni giving, all these other things, fell. The system is rewarding us for doing things that we all know are bad for society. And so a key part of the argument of the book is we’re not going to solve this by tweaking the existing system. We’re going to solve this by creating a new system that rewards people for inclusivity and diversity.

John: As you’ve just said, part of the issue is that all of the agents there are pursuing what’s rational for them. Their parents from high-income families spend a lot of resources in preparing for that. And we’ll include a link in the show notes to an earlier podcast we issued a few weeks back where we interviewed John Friedman, who is one of Raj Chetty’s co-authors on several of those studies. So we do address some of that in that podcast, and I encourage people to go back and listen to that if you haven’t seen that. But we have a system where it’s currently self-reinforcing, that institutions are doing what’s best for them, faculty are doing what’s best for them, and parents are doing the best they can, given the constraints that they’re facing. How are we going to get past those incentives to move to a more inclusive environment, or that would reward institutions for becoming more inclusive,

Michael: It’s going to be really hard within the existing system, I think there’s two options we’ve got. One is to rely on folks like Paul LeBlanc and Raj Chetty and Zvi Galil at Georgia Tech University, people who are willing to say, I want to create this, and I’m going to do it, even though I know it’s not aligned with my self interests, and I’m going to create a online educational experience, because I’m focused on the needs of my student base, rather than what the market is telling me to do. And I think that’s possible if we rediscover our mission. And the reason I say that is because you mentioned one of my previous books, and a lot of my previous research was about the entertainment industry and how technological change affected the entertainment industry. In looking at that, what I found really interesting is the industry initially opposed technological change, because they saw it, correctly, as a threat to their business model, their way of doing business. At some point, I had this really interesting conversation with a pretty senior creative person at one of the studios. And we were sitting in the lunch room, and he sort of leaned forward and quietly, so none of his colleagues could hear, said, “Mike, a year ago, we sold my show to Netflix, I want you to look at the season of my show that Netflix just put out, and you’re gonna see that it is in every way superior to what we did on the lot. The storytelling is better, the cinematography is better, and I just can’t figure it out.” They told themselves, the technology companies are going to make stuff that’s inferior than what we do, and what they were seeing with their own eyes, and not to mention at the award shows, the technology companies were actually making great entertainment. And I think it was that realization, where they said, “You know what, you’re right. Technology is a threat to my business model. But my mission is different than my model, my mission is creating great entertainment, and getting that entertainment in front of an audience. And my mission is so important to me, that I’m willing to blow up my model to pursue it.” I think that’s exactly what we’ve seen in entertainment. What’s the parallel here? What’s our mission in higher education, friends? if our mission is helping rich kids get a leg up in the job market, everything’s working just fine. But that’s not our mission. Our mission is helping people from all socio-economic backgrounds discover their talents, develop those talents, so they can use those talents to the benefit of society. I think we’re leaving a lot of people behind. And I would love for us to get excited about that mission, so excited that we’re willing to blow up the model.

Rebecca: We’re undergoing strategic planning at our institution. We’ve been having lots of interesting conversations about many of these things, actually, some of which are really inspiring to think about, like, what is the mission? If we’re really thinking about equity-informed student success, what are those metrics? How would we need to change how we’re looking at things to even know that we’ve achieved success? And what I’m hearing you talk about is there’s the difference between the institutional change that needs to happen, and then the broader machine of higher education. But when I think about cultural change, I think about bottom up and top down change. There’s regulation kind of change, but there’s also that grassroots change. And it’s almost like many institutions need to have this discovering independently to make some of that start happening. And force, bigger systematic change.

Michael: Yeah, I think we need bottom-up change in the sense of, I’m tired of being trapped in a system that forces me to make decisions to exclude people solely because they grew up in the wrong zip code. I think the other thing we need is some top-down change. And there what I talk about in the book is, back in the early 2010s, a lot of really smart, prominent people, including Clay Christensen, who I have a world of respect for, said that in 5 to 10 years colleges are going to be in real trouble, because we have this new technology. It’s 15 years later, that hasn’t happened. So I think a lot of people sort of roll their eyes when they hear technology is going to change our business. In the book, I try to argue, respectfully that I think part of the reason Clay Christensen was wrong, is he wasn’t using the right model of disruption. So his model says this technology comes in, and it’s going to create an inferior product and the incumbents are going to ignore it. What I’m trying to argue is that MOOCs and other online learning, if you think back to those three factors I talked about earlier, scarcity in the classroom scarcity in the experts, and scarcity in the credential. What online learning so far has done is its created abundance in who can get access and abundance to the faculty. What it hasn’t changed is the credential, the credential is still scarce. If you go to a Princeton or Harvard, or let me just eat my own dog food, Carnegie Mellon, people are going to assume you’re smarter than someone who went to a different school. What if we changed the way we did credentials? What if we would change the way we did credentials from this very brand-oriented credential that we have now to something that is closer to the student’s actual capabilities, actual skills? What the heck am I talking about? So the story I’ll tell is on my whiteboard as I was writing this paper, I had “brand” circled with a big question mark next to it. If the university brand name is the brand, how do you change the value of brand names? It’s really hard. So I’m scratching my head about this. And later that day, I was buying a really expensive scanner from a manufacturer I’d never heard of before, solely because it had a 4.9 star rating on Amazon and a bunch of really positive reviews. I was like, “Oh, crap, that’s how you change brand names. You add in objective information about the quality of the product.” I’ll stay in complete strangers’ homes, because they have a good rating on Airbnb, I’ll drive home with complete strangers, because they have a good rating on Uber. We see this in all these areas of society, could we bring that into the academy so that instead of judging people based on the name of their school, we start to judge them based on their actual skills? Wouldn’t that be cool. The other thing I’ll say, just to roll this out a little bit more is one of the things I think we’ve seen in these other areas of the economy is when you didn’t have the brand name, when you were an independent hotel no one had heard of, I’m going to assume you’ve got lousy rooms, and I’m gonna stay at the Hilton instead. Once we created a way to signal your quality, all of a sudden, a whole bunch of people who didn’t have the brand name had the incentives to invest in quality. We’ve got a whole bunch of places that aren’t Hilton, who are investing a lot in creating great room experiences. What’s the parallel? If we were to open up a way for students to signal their true skills, might we create a whole bunch of incentives for students to invest in those skills in ways that they just can’t right now, because I’m going to be judged based on the brand name of my school, instead of my actual knowledge?

John: Going back to the issue of markets, currently markets encourage institutions to maintain the scarcity. But they’re also subject to the Baumol disease of increasing relative costs, which is inherent in anything where labor is a major component of the production of the service. And with rising costs, while that maintains scarcity, it also opens up the market for other alternatives that can provide credentialing as an alternative to the traditional institutions. Could you talk a little bit about the Baumol disease and also perhaps, how that might encourage institutions to start shifting to other less expensive methods of credentialing?

Michael: Let me answer the second question first, and then come back to Baumol. Can we imagine ways that we could have new ways of credentialing students, and the example I used in the book is a guy named Gilberto Titericz. He worked for the Brazilian state oil company graduated from the 12th ranked Brazilian engineering college. And it just so happened in the evening, he liked to play around with Kaggle, which is an online place where you can go and provides awards for people to solve analytics challenges. And he got good enough that he had risen to the top of the worldwide leaderboard. And all of a sudden, Silicon Valley companies were recruiting him not because of his degree, not because of his work experience, not because of the GPA, but solely because they could see an objective signal that this guy’s really smart at analytics. I told this story to a buddy of mine who works in journalism, and he said, “You know what, Mike, I won’t hire anybody unless I can see their substack. I want to see if you can write. I don’t care if you graduated from Columbia’s journalism school, I want to know whether you can write.” And I think we’re seeing a lot of areas where you can have these signals. As an economist, it warms my heart that you would bring up Baumol’s cost disease. What Baumol’s cost disease says is that if every other sector of the economy is increasing productivity and economists define productivity as output divided by input. So you’re creating more output with less input. If you’re in a sector where every other sector is increasing productivity and your productivity isn’t changing, then your costs are naturally going to go up. And that’s very consistent with what we’ve seen in higher education. We’ve seen over the last 60 years, prices in higher education have increased at four times the rate of inflation, Or said another way, if they kept pace with inflation, college would cost 25% of what it is today. How do you change that? How do you improve efficiency? Well, you got to create more output with less input. I don’t see how we do that within the bounds of the existing classroom. We might be able to do that if we intelligently adopt technology in ways that allow us to educate more students with fewer resources than what we’re using today. The problem is, that’s really scary for a lot of my colleagues, and myself, as I’m very transparent in the book that this poses a threat to me too. And I think this brings us to the point where we’ve got to figure out what’s my core value here. One of the quotes I have in the book is a colleague who, a bit tongue in cheek, and I’m going to use it with permission but without attribution, said, “You know what, Mike, the professor has to have an incentive to adopt the technology. I’m a tenured old fart, I can ride out this technological change until I retire. Technological adoption will occur one funeral at a time.” And again, I know he was being cheeky, but I think in the back of our minds, a lot of us are like, “I’m just going to try to hang on to the existing thing for as long as I can.” I’m not sure we’re going to be proud of that decision 15 years from now. Congratulations, you’ve presided over an institution that you know is leaving deserving kids behind solely because they grew up in the wrong zip code. You’ve benefited yourself, are you proud of the outcome? I don’t think we’re gonna be.

Rebecca: It’s really hard to make those choices, of course, when you’re feeling very comfortable, and those choices may make you very uncomfortable. But I think that’s just in terms of the personal impact versus that bigger social impact that I think many of us are really committed to, but then our actions don’t always follow that commitment.

Michael: Yeah. And again, I try to be transparent as possible in the book that I’m as subject to this as anyone, friends. It wasn’t until I started staring at this, that I really had this “Oh, crap” moment of “I’m doing things, we’re doing things that are contrary to our values. Maybe we need to start questioning the structure and thinking more about those values.”

Rebecca: What role do faculty have in starting to initiate these changes?

Michael: It’s a great question, I think we need to start questioning the assumptions. Here’s a good starting point for that. I was talking to another colleague about this. And what she said, and this is going to be close to a direct quote, was, she said, “We train our students to identify and dismantle unjust social structures in every aspect of society, except our own.” I would love for us to start thinking about our own unjust social structure, and how can we change it in a way that creates more justice for students who deserve it. And the only way I’ve been able to come up with ideas about how to do that is by changing the structure. I just don’t see how we do it from within the existing structure where I teach 35 students for 80 minutes at a time twice a week, blah, blah, blah. The cool thing is, I actually think we have a decent number of examples of success, success, not only in creating more equity, but also in creating a viable and sustainable system. If you look at what Paul LeBlanc is doing in Southern New Hampshire University, if you look at what Mike Crow is doing at Arizona State University, if you look at what Zvi Gali did at Georgia Tech with his online master’s in computer science program, I think they’ve all been very successful at increasing equity, and also very successful at creating a sustainable business model.

John: So what should other institutions consider doing to transform their institutions into one which is more sustainable?

Michael: This is where we get into strategy. And, again, I teach technological change and economics and strategy. I honestly think, if you’re looking at this as we want to create mass market four-year degrees, I think Southern New Hampshire and Arizona State have a big lead in the market, and it’s going to be hard to catch up to. But if you’re looking at niches, if you’re looking at specific degree programs, I still think there’s a whole bunch of opportunity out there to say: “Can I create a program that appeals to a specific market engineering, for example, that is delivered online, but it’s delivered online in a very high quality way.” And I’m going to even pause there for a second and say, delivered online is probably too strong. So in my technological change course, I bring in the head of data analytics at the University of Pittsburgh Medical Center to talk to my students about how data is changing health care. And right after the pandemic, he came in and said, “You know what, Mike, we’ve looked at our data and what we’ve discovered is that for most doctor-patient interactions, telehealth yields equivalent health outcomes as you coming into the office. There’s some things you’ve got to come into the office for, but most things, telehealth works just fine.” What’s the parallel? I think there are a lot of things we do in higher education that can be delivered perfectly well remotely. Some things need to be done in person, and I would love for us as educators to think really hard about what are the things that have to be done in person, and what are the things that can be done perfectly well online, maybe even better online? So it’s not 100% in either direction. And then I’ll have people say, well, there’s some things trying to get it more in the in person side. And the example I think of there is I talked to Ara Austin, who’s the professor at Arizona State, who teaches organic chemistry remotely. You say, “How the heck do you teach organic chemistry online? Are you mailing hydrochloric acid to students’ homes, and hoping they have a fume hood somewhere available?” And the answer is, what they did is they looked at their curriculum, and they discovered that 13 weeks of the 14-week semester can work perfectly well online. For the labs, they actually bring students on campus, and they do a one-week intensive organic chemistry lab experience, you do two labs a day for six days. And what they’ve discovered in serving the students is that the online students’ knowledge of organic chemistry is equivalent to the residential students, but they walk out with a higher identity as scientists. There’s something about doing two O-chem labs a day for six days that you walk out and say, “I’m a scientist, I can do this,” that you wouldn’t get if you did those same labs, one lab a week, over the course of a 12-week semester. I think there are a bunch of things out there where I’d love for us to get excited about saying how can we redesign the classroom in a way that might even create better educational outcomes, while also including a whole bunch of students who otherwise would have been excluded.

John: One of the challenges is that student bodies have become increasingly diverse, but instruction is often aimed at the student in the middle of the distribution. One of the things Carnegie Mellon is known for is the Open Learning Initiative and the development of adaptive learning platforms. Is that something that colleges might be able to leverage to increase the scale of classes to lower the cost per student?

Michael: Yes. And heck, yes. So let me go back to my roots studying the entertainment industry. One of the really interesting things about the rise of streaming platforms is… we’ve actually got a paper coming out showing that we’ve seen an increased diversity in casts on streaming platforms, because you’re not tied to the mass market delivery. When I teach a class, and I talk about this in the book, of 30 students, I’m pretty sure 10% of them are bored, and 10% of them are completely lost. The problem is that, in that delivery modality, I have no time for the 10%. I’m trying to keep the middle 80% of the class happy. Wouldn’t it be cool if I could identify the 10% of students who are bored and say, “Alright, let’s go on to the next topic,” and identify the 10% of the students who are lost and say, “Alright, let’s spend a little bit more time on this topic so that you get it before we go on.” We can’t do that in the traditional delivery model. But we can online. There are a lot of ways to say I’m going to personalize this in the same way that streaming platforms say I’m going to personalize what’s being shown to your preferences and needs. I think we can personalize the way the education is delivered to the preferences and needs of the individual student.

John: And I could see a system where that results in recommendations for students for their next courses. You’ve done well in this, you may want to consider these alternatives for next semester.

Michael: Yeah, I talked to a colleague in the business school who got his degree in electrical engineering. And as I was talking about this, he said, “You know what, I just saw a YouTube video and for the first time understood what a Fourier transform was, and what it was used for.” This is this key concept in electrical engineering and signals. 20 years later, he saw a video, he’s like, “Oh, that’s what it’s for. I can do it mechanically, but I never really understood.” Wouldn’t it be cool if we could have a set of different ways of explaining a concept and match the different ways of explaining to the students to what we think the student is likely to resonate with? The other way of thinking about this is students’ preferences for faculty. Here’s what I mean by that. When my daughter was president of the STEMinest club at her high school, so take feminism and combine it with STEM and you have STEMinism. And when she was going into her senior year, my STEMinest daughter wanted to take AP physics. And the high school said, you can’t take AP physics because you don’t have AP calculus, you can’t take AP Calculus, because you don’t have precalculus. And you can’t take precalculus, because we’re not offering it this summer, I’m sorry. And that didn’t really work for me and my wife. And because of the research I was doing, I knew that there’s a site called Outlier.org that delivers a whole bunch of classes, including calculus. And by the way, if you pass the class, you get credit at the University of Pittsburgh. So my going back position was, “Hey, if my daughter passes this class that gives her credit at the University of Pittsburgh, are you really telling me that’s not good enough for high school calculus?” Anyway, we won that argument. What was really interesting about the way Outlier designed her class is they had three different teachers teaching the same modules in their own voice. So Tim Chartier, a white guy like me, calculus professor at Davidson; John Urschel, African American scholar, who just finished his PhD in math at MIT, and by the way, before he started his PhD, was the starting guard for the Baltimore Ravens. So munch on that for a second; and then Hannah Fry, University College London. And they each teach the same topics in their own voice. And you, as the student, can choose which of these professors do I take? Guess which Professor my STEMinest daughter gravitated towards. She immediately gravitates towards Hannah Fry. And I mentioned this to a colleague, and what my colleague said, “Oh, Mike, there’s a bunch of research that shows that, in general, men do better than women in quant- related classes, and that difference goes away when the class is taught by a woman, and by the way, the same thing is true for underrepresented minorities. In general, lower performance, and that difference goes away when the class is taught by someone who looks like them.” Wouldn’t it be cool if we can allow students to self select into the teaching style or the background of the professor that’s most going to resonate with them? It’s really hard to do that in the traditional environment, but we can online.

Rebecca: Yeah, I think this personalization is something that I’ve also been thinking a lot about, and it’s super possible. We have the technology to do it, just our institutions aren’t keeping up. And as a designer, I am always thinking about audience. And when I’m working with my students, we’re constantly talking about how it’s impossible to design for everybody. Like there’s no such audience as everybody, [LAUGHTER] there are specific people who are in your audience, and the more specific you can get, the better you can design the experience. And that’s exactly what you’re describing.

Michael: Exactly. Yeah. And it’s gonna be really hard if we take the existing 30 person twice a week delivery model as a given. But if you relax that assumption, there’s a whole bunch of really cool things you can do.

John: Changing the focus a little bit, you talk about how faculty perceive the role that we play in preparing students for their future careers in education. But you also present some evidence on how employers and the public and students perceive the way in which we prepare students for their futures. Could you talk a little bit about that?

Michael: Yeah, there’s this huge disconnect, respectfully to my colleagues, between how we perceive ourselves and how the outside world perceives us. In 2020, I wrote a piece in The Atlantic, basically saying that higher education in 2020 looks a lot like the entertainment industry did in 2015. We are fat and happy and completely unaware that technology is about to change how we deliver our product, for lack of a better word. What was really interesting is the feedback on that piece from outside the academy was overwhelmingly positive, and frequently expressed a great deal of anger and frustration towards the institution of higher education. The feedback from within the academy was overwhelmingly negative and frequently expressed a great deal of anger and frustration towards anyone who would question the institution of higher education. Like there’s this enormous disconnect. It almost reminds me of early in the demise of the cable subscriptions. So there’s a guy named Chase Carey, he was the COO of 21st Century Fox, and in 2013, he was asked at an investor’s conference, “Are you at all worried about people canceling their cable subscriptions?” And he said, “Not at all. People will give up food and a roof over their head before they give up cable television.” And my guess is he said that because he had surveys showing that people will get behind on their mortgage and behind on the credit card payment, beforer they get behind on their cable bill. But it wasn’t because they loved cable, it was because they had no other alternatives. I think we, in higher education, look at “people keep showing up. People keep showing up and paying my high prices, they must love my product.” I think there’s another way to interpret that data and it is they have no other options than to paying us a whole bunch of money. The smart thing for us to do from the perspective of the business model is to eliminate any other options for students. But I think the right thing for us to do from the perspective of society and our own moral standards, is to want to create other ways for students to get the knowledge they need so they can just demonstrate that knowledge in the workforce. That’s the change that I think needs to happen in how we look at these things.

John: That’s a message I think that we all need to hear a bit more often, because it’s really easy to become complacent with where you are and what you’re doing and just assuming that it’s serving everyone’s needs, and we don’t want to be in the position of the cable companies or the traditional print newspapers and so forth in response to a changing environment that may make us obsolete unless we adapt.

Michael: That’s the hard part. What’s interesting to me is how hard it is for market leaders to identify and respond to change. And when I teach this in class, if you teach it really well, disruption is an incredibly depressing topic because the last slide in every good disruption story is “and the incumbent died.” Blockbuster, dead; BlackBerry, dead; Britannica, dead. And if you teach it really well, there’s some kid in the back of the class who’s gonna go: “Can you get any example of an industry that responded well to technological change?” And for a long time, I sort of mumbled that answer, but now I’m starting to say “the entertainment industry.” If you look at what Bob Iger did at Disney, he blew up their organizational structure to go after this new opportunity. I’ve got this really interesting quote of Bob Iger saying, “When I launched streaming and Disney plus, I looked at my organizational structure, and I realized that it didn’t make sense anymore.” And if you sort of dig down, every entertainment company has a president of home entertainment, president of television, president of theatrical, president of international and all those peoples’ jobs is to protect the old way of doing business. Bob Iger blew that up and created an organizational structure that looked a lot like Netflix. What’s the parallel here? I think we need to think really hard about our incentives and our organizational structure, if you will. I was talking to Zvi Galil at Georgia Tech, and what he said is, “I got the faculty to adopt this online teaching method by changing their incentives and making it in their financial interests to teach online.” I think, leaders at the top, if we want to adopt this, you’re gonna have to think really hard about what’s my existing incentives, and how can I change those incentives in a way that encourages faculty to adopt this new innovation?

Rebecca: In your book, you have an interesting story about a president who gave a talk about why it cost $60,000 to attend my university. Can you share that story with us?

Michael: Love to. I’ve given this talk at a bunch of different universities, and when you give this talk, you have these interesting side conversations with people and one of those side conversations was someone who had heard their President give a talk to a local community group titled “Why does it cost $60,000 to attend university X?” and the President said, three reasons. Number one, technology doesn’t lower my cost, it actually increases it because I still have to maintain all the big buildings and now I have to invest in new technological systems. Number two reason that it cost $60,000 to attend my university is because I got to keep up with the Joneses. If all of my competitors are building big, beautiful dorms and big, beautiful buildings, I’ve got to build those same buildings if I want to remain competitive, and the number three reason because I f’ing can, although he didn’t use f’ing, he used the actual word… because I f’ing can. And he went on to say, “Every year I raise my prices, and every year I get the same number of students, if not more.” And while he didn’t use those words, what he’s saying is, I’m not on the elastic point in the demand curve, my market is inelastic to price increases, why shouldn’t I increase my prices? And so I came home and shared this story with my wife, which I found pretty compelling. And my wife who has an MBA and a Master’s of Public Policy, she doesn’t leave me to mansplain price elasticity to her. She listens patiently and nods. And then at the end, she says, “So, let me see if I’ve got this straight.” And after 30 years of marriage, what I’ve realized is, “let me see if I’ve got this straight” is shorthand for I’m about to destroy you rhetorically. “So this university is a 501-C3 nonprofit.” “Yeah.” “So that means they’ve taken tax-exempt status from the government in exchange for an agreement to act in a way that is consistent with the public good.” “Oh… yeah.” And she said, “I’m fine if they want to behave like a profit-maximizing monopolist, just give back the tax-exempt status.” I don’t mean to pick on any university presidents. They’re doing what their incentives tell them to do. I would love for us to come back and say, “What’s my mission?” If my mission is to increase my prices, because I’m not on the elastic point of the demand curve then go for it, but give back the tax-exempt status. The tax-exempt status implies that my mission ought to be bigger than that, ought to be doing what’s right for society. And I think that’s going to require a lot of change.

Rebecca: Thank you just underscored our call to action for this episode.[LAUGHTER]

Michael: I hope so.

Rebecca: Perhaps this is a great moment then to switch to our last question, which is: “What’s next?”

Michael: What’s next?, I think what’s next Inside colleges, is for us to get more excited about our mission, and then changing our model to best support that mission. And like I said, I think that’s going to require a lot more technological adoption than what we’re seeing today. Honestly, I think what’s next outside of higher education is for employers to start to adopt more hiring practices that, frankly, de-emphasize the four-year degree in favor of emphasizing skills. “Do you have the skill? I don’t care where you got it from.” I think we’re starting to see that. And when I give this presentation, I’ve got a slide in the presentation that has a bunch of headlines from press outlets saying this or that company is de-emphasizing the four-year degree in their hiring practices. The next build of that slide is a quote from each of those articles saying, “and they’re doing it because they want a more diverse workforce. And they’ve recognized that I can’t get that diversity if I continue to rely on elite colleges.” A, I think that means employers are starting to pick up on the fact that colleges aren’t delivering the students that I want , but B, I think that ought to be a call to action for us in higher education. Because if you think about it, what it means is that the evil capitalists in the business market are further along than we are in terms of embracing diversity. Maybe now’s the time for us to try to catch up.

Rebecca: Well, thank you for such a great conversation and many things for us to be thinking about as perpetuators [LAUGHTER] of the higher ed system as it exists. So I think there’s a lot of room for us to each, individually, make small moves to start shifting things.

Michael: And I want to put a big caveat on a lot of what I’ve said here, I don’t know anybody in higher education who would say “I’m excited about excluding people,” I genuinely think we’re all on the same page. I just think we’ve gotten into this world where we assume that what we’ve always done in the past is the right thing to continue to do. And I’d like for us to question those assumptions.

John: Well, thank you. You’ve made a lot of really good arguments about the need for change. And I’m hoping that we all start thinking about ways in which we can adapt to create a more inclusive educational environment, and perhaps slow down that cost increase or find alternative routes to training our students to become productive members of society.

Michael: Thanks, John and Rebecca, it was wonderful being here with you and I really appreciate you having me on the show.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

334. Journey Toward UDL

Most faculty begin their teaching careers with little preparation in effective teaching practices. In this episode, Jeanne Anderson joins us to share her journey toward inclusive teaching practices and universal design for learning. Jeanne is a faculty development coordinator at Waubonsee Community College, and an adjunct faculty member in the English departments at Elgin and Waubonsee Community Colleges, and the College of DuPage. She teaches a mix of online, face-to-face, and hybrid writing courses.

Show Notes

  • Tea Tree
  • ACUE
  • 4 Connections Curriculum
  • Transparency in Learning and Teaching (TILTHigherEd)
  • Behling, K. T., & Tobin, T. J. (2018). Reach everyone, teach everyone: Universal design for learning in higher education. West Virginia University Press.
  • Tobin, Tom (2020). Pedagogies of Care: UDL. Tea for Teaching podcast. Episode 138. June 3.
  • Angelo, T. A., & Cross, K. P. (2012). Classroom assessment techniques. Jossey Bass Wiley.
  • Darby, F., & Lang, J. M. (2019). Small teaching online: Applying learning science in online classes. John Wiley & Sons.

Transcript

John: Most faculty begin their teaching careers with little preparation in effective teaching practices. In this episode, one faculty member shares her journey toward inclusive teaching practices and universal design for learning.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Jeanne Anderson. Jeanne is a faculty development coordinator at Waubonsee Community College, and an adjunct faculty member in the English departments at Elgin and Waubonsee Community Colleges, and the College of DuPage. She teaches a mix of online, face-to-face, and hybrid writing courses. Welcome, Jeanne.

Jeanne: Thank you, John.

Rebecca: Today’s teas are:… Jeanne, are you drinking tea today?

Jeanne: I am. I was out and about today, and I stopped at the Tea Tree in downtown Batavia and told them I needed something tasty that would give me some endurance, because I’m a little tired today. I just got over COVID. And so they actually made me a cup of endurance tea.

Rebecca: Oh, look at that.

John: Excellent.

Rebecca: Who knew? [LAUGHTER]

Jeanne: It’s a mix of herbs that have been traditionally used for increasing stamina.

Rebecca: Well, I hope it works.

John: I do too.

John: And I have English breakfast tea today.

Rebecca: Oh, it must be a theme. I have Scottish afternoon tea. We’re all looking for a little energy. [LAUGHTER]

John: …which is a little more appropriate because we are recording in the afternoon, at least here on the East Coast. We met at the POD conference back in November and we sat at the same table at one of the sessions. And we talked a little bit about your practices. And we’ve invited you here to talk about how you’ve integrated inclusive teaching practices, including UDL into your writing classes. Could you tell us a little bit first about what prompted you to adopt a UDL approach in your classes?

Jeanne: Well, John, I have four kids between the ages of 14 and 21. And three of them are neurodiverse. And my 21-year old has autism. My 15 year old has dyslexia and my youngest has ADHD. I started teaching in 2000. I became a mom in 2003. And autism was a word that was introduced in my life in 2005, when my son was 21 months old. So throughout the time that I was starting to teach, and also then throughout the time that I was raising my son, there was a constant theme of having to meet him where he was at, because most normal kids, babies, you would put them in a stroller and go to the mall, and they’d sleep, where my son would cry and scream. But if I brought him home, and he went in his little swing, he was quiet and he was content and he was happy. And so there were just a lot of things that I had to give up at that time to be able to meet his needs. So I had an interview for an adjunct position while I was still in graduate school, at a college in Chicago on a Tuesday afternoon, right after Labor Day. And by mid-afternoon, they were walking me to HR, and I was being told that I would have a class very soon. And then the man I interviewed with, Mr. Haynes, he turned out to be one of my mentors, he came back and he said, “Oh, can you sub tonight? You get paid $150, all you have to do is pass out the syllabus and turn on a video.” And I was like, I could watch a movie for $150.” So I go down and I do my subbing thing. And he knocks on the door, and he hands me a set of books. And he says, “Okay, your class is Monday, Wednesday (it’s Tuesday night I won’t be home till 10). your class is monday, wednesday at eight o’clock in the morning, and you’re teaching Comm 101. And I’m thinking “this isn’t even my discipline.” And so I kind of got thrust in this classroom, not knowing how to teach, as many of us are, and we rely on the good or bad practices of our previous instructors in college. Really, one of the first principles that I talk about, one of the first things that I have to be intentional about, is meeting students where they’re at. And I do that because, at the time, I didn’t know what else to do with them. And so I would just gauge who they were and what their needs were and I would try to meet those needs. And so that’s really the first seven years of my teaching career, I kind of relied on that principle of just doing what my other teachers used to do, and meeting my students where they were at.

Rebecca: Definitely a good way to get involved in inclusive teaching and a good framework to dig into a lot of models that are out there.

Jeanne: Definitely, and this college, they didn’t have any remediation. And they really took a lot of students from Chicago Public Schools who truly needed the remediation. And so as a faculty member in these classes, I really had to figure out what their needs were. I couldn’t fix them, but I could give them the best college experience that I could in the courses that I was teaching. And so that’s really what I sought to do. It was also a very diverse group of students. Most of my students were either Hispanic or black. And so, again, another reason to just meet your students where you’re at, get to know them and make them feel comfortable. They’re in a setting where they feel like they don’t belong. And so years before I knew about imposter syndrome, I’m in a classroom having a severe case of impostor syndrome with a group of students who also have impostor syndrome, and that’s really been the bedrock of how I started working with students in the classroom, is making them feel comfortable. Some of the professional development that I’ve done has really informed my teaching practices in a new way over the last few years. The first third of my career was me just kind of figuring out how to teach and also having a child with autism, and using some of the skills that I picked up by raising him, applying those things to the classroom. Whether it’s slowing down my speech and being more intentional and direct in the things I say, that was one thing that I did with him. The second third of my career, we adopted two children, and so I kind of took a backseat. I was still teaching an insane amount of classes, but I wasn’t really making much movement in professional development. And that’s where I was working on getting diagnoses for dyslexia and ADHD, and trying to figure out in their education, like how does trauma inform their education? How are learning disabilities informing their education? How does the fact that they grew up in a Spanish speaking home for the first four to six years impact their education? These are all things that I can think about when I’m talking to my students, because as a writing instructor, especially since my first assignment in English 101 is a literacy narrative, they’re very open about if they grew up in the Spanish speaking home, or if they had a learning disability and they hated school, and the fact that they know that I have this background kind of fosters that engagement and connection. So the last five years, I’ve really focused more on professional development. And I took the ACUE courses. And then I became a Faculty Development Coordinator, and at College to DuPage, they offered a paid course for adjuncts. The curriculum was 4 Connections, that’s what the course was called. 4 Connections comes out of Odessa College in Texas. And the 4 connections are checking in with students regularly, practicing praxis (which means maintaining rigor, but also having flexibility), one-on-one check-ins, and learning students’ names. And so as far as inclusive teaching practices are concerned, again, these are all things that when I started teaching, they were almost frowned upon. You don’t want to engage with your students too much. You’re there to lecture, they’re there to learn, and there’s no late assignments, and if you plagiarize, then you’re out of here. And these were all habits of faculty back in the early 2000s that I grew up under, but that didn’t work for me. And so I looked at these 4 connections, and all of a sudden, it was very validating, because it was like, “Well, I’ve kind of been doing this all along, checking in regularly, that’s something that I do with students, the one-on-one meetings, that’s the one that always kind of enrages faculty, especially adjuncts because of how thinly we’re spread. But if you can get past the I don’t have to meet with every student one on one, I started that process by saying, Okay, we’re post pandemic, I’m comfortable with Zoom… I went from “Why are you taking an online class, if you want to talk to me, you should take an in-person class,” that was kind of the mentality of the early 2000s and mid 2010s. I went from that to, “Hey, it sounds like you could really use a zoom call. Let’s get together. Let’s have a one on one, let’s talk” and really just students getting to know me and me getting to know them a little bit really helped get them on track. They needed that engagement to get on track. The practicing praxis, I used to be told in my early years, “Oh, you’re too flexible. If it’s past the deadline, you shouldn’t take it, it’s a zero.” And in the culture that I was working in, nobody was turning things in on time. There were so many obstacles to the students I had in the beginning. Being a writing instructor, students definitely walk into your classroom not wanting to be there, and believing that you are judging them from the get go. And you kind of are. And so it’s always been my intention to make students feel comfortable so that I can get the best writing from them as well.

Rebecca: What are some of the strategies that you use to make students feel comfortable?

Jeanne: I was thinking about my teaching style, and how I would talk about it. I came up with four principles that I really follow: being intentional about meeting students where they’re at, so getting to know your students and meeting them where they’re at while also maintaining rigor and meeting those learning outcomes on the syllabus, because those are two very important components of getting your students through your college courses. I’m also very intentional about engagement. So when I start a class, whether it’s online or face to face, I want my students to know that they’re making friends in this class, and that they and their peers and myself were all part of a learning community, and I’m learning from them. I don’t necessarily call myself an expert. I have so much to learn. And a lot of things that I learned, I learned from my students. I give them an assignment, and they give it back to me, and then I learn about what are the good aspects of that assignment, and what parts of that assignment really need to go. My students teach me that. I can’t learn that on my own. And so having that rapport and that engagement in the classroom is very important to me, especially since the majority of the courses I teach are online. Being transparent is also very important. And I was introduced to the TILT framework (Transparency in Learning and Teaching). And as an English instructor, and as an online instructor, I have to give very clear guidelines to students, because I’m not in the classroom with them. So they have to be able to read the guidelines and follow them. And so I’ve always been pretty good at writing those assignments and getting that across. I’ve tweaked it over the years, being more intentional about letting them know the reason why we’re doing this assignment. I’ve never been a teacher to have like a bunch of readings just because we should have a bunch of readings. Whatever unit we’re in in the English 101 class, I want the exercises that we do in these classes to help them in their final destination of that research essay that they’re putting together for the course. And then the fourth principle has to do with the UDL implementation. And that’s really having that plus-one mindset. Adopting a plus-one mindset is really important, because there’s always one thing that I can do, maybe I’m just doing one thing this week, maybe I’m doing one thing a day, maybe I’m doing one thing a semester, but there’s only one way to improve my curriculum. There’s always one way to improve meeting students’ needs.

Rebecca: So for folks that are interested in that plus one mindset, it’s introduced in Reach Everyone, Teach Everyone by Tom Tobin and Kirsten Behling.

John: And we do have a podcast with Tom that we’ll share a link to in the show notes. Maybe you could talk a little bit about how you’ve implemented some of those UDL principles in your class, as you’ve continually done the plus one thing.

Jeanne: Well, they talk about multiple means of representation, multiple means of expression and multiple means of engagement. So I’m always looking at my curriculum and thinking, how can I better represent, how can my students better express what they know? And how can we improve engagement? For multiple means of representation, I started revising my syllabus, first of all. I tried to use more inclusive language, a little more colloquial, a little more warm, not having these really strict rules, but kindly sharing what was expected of students in a tone that reduced that imposter syndrome, telling students directly in my syllabus “you belong” is important. Another thing that I did, I learned about how to create like a visual graphics syllabus. For example, for my English 101 class, we have four papers that students write. And so on one page, I outline the entire course with what the whole course will look like and some of the things that they’ll be learning. Under each paper, I would talk about specific skills that they were going to pick up under that paper, during that unit. So they could see the entire class on one page. It will list the papers and what percentage they’re worth. And it’ll list a little description of what is involved. Our final paper in the English 101 class is a career analysis project. And so day one, I want them to know, “Hey, you’re going to be writing a paper about the career you’re interested in.” So let’s start thinking about that. And so a lot of the scaffolding that I put in place from paper to paper helps students follow the general outline of the course. I also use a skeletal outline. When I teach a face to face course, I actually set it up on whatever learning management system I’m using in the class. I set it up the same way I would an online class. I do that because I don’t want to forget anything. But at the beginning of class, I can go over the page and say, “Okay, these are all the things that we’re going to get through today.” And students know, and they’re not getting restless in their seats, especially because I mostly teach night classes. And you can just imagine By seven o’clock how much they want it to be over. And thankfully, I don’t have a ton of content that I have to get through. And so it’s like a half discussion/lecture, half of the class is us working together. And the other half is lab time. And as part of like an inclusive teaching practice, during lab time I meet with students regularly, one on one. And again, I’m getting to know them, I’m finding out “How was work today?” But I’m also finding out “Where are you at with your writing practice today?” And if you put something in place for one student, every student can benefit from that. So like if I have a blind student who needs her readings to be audio, the mother who is driving her kid to soccer practice can also benefit from having an audio version of the text. I’ve really embraced that idea of, when I put something in a course, trying to give them a graphic, trying to give them the text, and then trying to give them an audio or audio-visual component. I use Zoom a lot to create my videos. And so we have the closed captioning, they have the PowerPoint, they have the option of reading the transcript, maybe all those things can be overwhelming, but then turn off the closed captions and just have the PowerPoint and the talking. A lot of times I don’t even have the PowerPoint, I just have the screen for the learning management system, which is not always smart, because I use three different learning management systems, so that I have to keep re-recording those videos.

Rebecca: It sounds like those alternative formats are really helpful for students in giving options to explore the content and giving variety. And it sounds like you’re guiding them through picking and choosing which format works best for them.

Jeanne: Absolutely. And in 2010, when I got my big start in online teaching, I had completed a master’s certificate in online learning through Illinois Online Network. And actually, that was the first time I had ever heard about things like summative and formative assessments. So I was using classroom assessment techniques or CATs to check in with students. So those were things that I was learning in this class that I didn’t know about, then fast forward to last semester, and now I want to learn more about universal design for learning. So I started a digital accessibility for educators certificate. And we had a course for the foundations, we had a course where we just learned the basics of manipulating documents and making them accessible. I did another course that did the same for videos, and then the full eight-week UDL course, but the videos was interesting in that they actually recommended that your videos only be two to three minutes long, which if you’re used to teaching an hour and a half class, how do you get a two-minute video to educate your students. And I think part of that is students are used to watching shorter videos. And so if you have a 20-minute lecture, chunking it into four different videos can be very useful, because even when they have to go back, they know that that information that they want to review comes from video two, or video three, and it breaks things up for them. And you can set them up where one flows into the next

Rebecca: You were just summarizing the different ways that you were implementing multiple means of representation. You’ve talked a little bit about multiple forms in your syllabus, you talked about skeletal outlines, and then you were just talking about multiple formats for lectures. So one of the other UDL principles is thinking about multiple means of expression or ways that students can demonstrate their learning. Can you share some of the ways that you’ve implemented that into your teaching?

Jeanne: Sure, well, again, because I teach primarily online, I rely very heavily on the discussion boards. And so I do definitely start out with the icebreakers. And it’s not a best practice to answer every student on the discussion board, but for the icebreaker I do, because I want them to know that I heard them and that I have a response for them. And so I really tried to be very intentional. And then as the discussion boards increase throughout the semester, I back off and let my students engage with each other. But what I love about the discussion boards is it democratizes the classroom, because if a student is put on the spot right there in the classroom, they can’t always process the information quickly enough. They might be shy, they might feel like they just can’t come up with the answer right then and there. But when you’re on a discussion board, a student has the opportunity to read the question and thoughtfully respond in their own timing. And that really matches the work that I do. I’m definitely better at creating courses in writing and using instructional design techniques to lay out my classes and have everything set up, do all the writing of assignments, I’m much better at the organization than I am at getting up in front of students and lecturing. That’s just what I’m better at. And so I can really understand the idea of having a new concept introduced to me, and then having the opportunity to really think about it, maybe do a little research and pull my thoughts together before I respond. And so I think having those discussion boards, sometimes I even integrate them in my face-to-face classes just to give students other opportunities to engage. I have a literacy narrative assignment, where I allow students to either write the essay, or use another modality. So like, every once in a while, I’ll have a student who will want to make a video, I don’t have all the techniques of what video software you should use. Sometimes having all that information can be daunting. In today’s age, you know, my son, he’s 21, so he’s a junior in life and he’s working in the trades. So he’s not in college. But he started using a Chromebook in sixth grade. So we have students now who have capabilities in video production that I don’t have, just because they’ve been doing it in their elementary, middle school, and high school classes. So I also have an option for them to create a comic. Because we have an example in our textbook where somebody wrote a literacy narrative,as a graphic comic. Every once in a while, I get the drawers who want to have their literacy narrative that way. And so again, there’s just multiple ways. Writing class, you can’t always have a video, students have to write. But I can sometimes give options, the literacy narrative is a great place to give students the opportunity to showcase their story using another modality. I provide examples whenever possible. I ask my students “Can I use this?” and I get more and more questions from students about, “Can I have an example?” And sometimes I don’t want to give them one, I just want them to respond. It’s a low-stakes assignment, and I want them to think. I don’t want them to see somebody else’s response. I just want them to tell me what they know. But especially for larger essays, I want to make sure that they have those examples. We read a lot of essays from published authors, but having examples from their peers, and especially examples from peers that had me as their instructor, can be very helpful to students being able to then turn around and express their thoughts in writing. And this is also where that TILT model comes in, because I want to tell them why they’re doing the assignment, the literacy narrative, the purpose is for me to get to know you as a student, as a reader, as a writer. It’s an opportunity for you to tell me your story, and what the actual prompt is, what the skills they need, there’s always a rubric for them to follow to guide them. I give them an idea of what I expect in the final product. And sometimes I’ve been learning more and more that sometimes, using specifications grading, it’s either you met the objectives, or you didn’t can be very helpful in some of these writing assignments. One of my favorite writing assignments is… I got this at a conference at College DuPage, like maybe in 2016, and I adopted it, and I’ve been using it for years, but only in the face-to-face classroom. It’s students pairing up to groups of two or three, and they choose a movie and they do their own version of “At the Movies with English 101.” I don’t know if you’re old enough to remember this, Rebecca, I know John is, but Siskel and Ebert At the Movies on Sunday afternoon, I watched it with my dad every week and so I get to nerd out a little bit and do things I love and show them all these different clips of Siskel and Ebert. And then they get to pair with somebody and watch a film and write a script that they present to the class. And so what I’ve learned over the years is that it’s not even really necessary to grade this assignment, because I’m really only grading on grammar and punctuation because they work so hard on it because they’re presenting it to their peers, and they’re working with another classmate that it’s a pure learning experience. And last semester, I had a student who was talking to her partner, and she said, “This is so fun. This is like doing a podcast.” And I thought, oh my goodness, I can bridge. I tell them to write a script and they look at me like a deer in headlights. But if I say they’re gonna do a podcast about their favorite movie, now I’ve reframed the assignment in terms that they understand. So that’s what I’m going to do next time. And like I said, if you’ve done the assignment, you get full credit because I’ve never had a student not do the assignment. I do have a rubric for the person who takes advantage, just in case they’re out there. And really the only way to lose points is if you don’t present your individual reflection on the entire process. So I feel like that is just one of those ways to meet students where they’re at by giving them the freedom to work with somebody else and see what kind of writing they can produce without too many parameters. And they’re almost always successful.

John: You had mentioned something about a career analysis project. Could you tell us a little bit about that?

Jeanne: Sure. That came out last spring, I had a late start class. And they were supposed to be writing an editorial and I was barely getting film analysis and literacy narrative essays from them. They were really struggling as a class. And I was trying to figure out a way to motivate them. And I’m thinking, if I have them write an editorial, that’s not going to work for this group. And so I scrambled, and I thought, well, as a freshman in college, most of the students who take English 101, this is their first time in college, and thinking about the TILT model, what can they write that gives them purpose? And so I came up with “Well, every student’s going to want to get out of college with a career, and we can still meet the learning objectives in the class.” So the final product is the actual essay, and that is totally graded with a rubric and they have to meet all the learning objectives, work cited page, introduction, thesis statement, all those components of a basic essay, source integration, synthesis. We’re in the early stages of getting them ready for that English 102 class. And so they can write an essay about their career meeting all those objectives in the same way that they could write an editorial meeting those same objectives. And so I always start a paper like that with an annotated bibliography. And so I got the librarians to help me find websites where students could research their careers. And so the librarians put together a page for me that students can refer to, and I’ve since created short videos, where I explain the different databases to them. Right now, I think I have like a 12-minute video that I did. So the next step is, instead of talking about all the databases in one video, talk about different individual databases in two to three minutes, breaking that down and meeting them even better than I was with a 12-minute video. So they write their annotated bibliography, and that gives them an opportunity to work on MLA citations, work on summarizing, and thinking about how they’re going to use that material for the final essay. That’s part one. Part two is using ChatGPT to have a conversation, I call it a ChatGPT interview. And so now that students have done the research on their own, now they’re taking what they know and I give them a series of prompts. And I’m giving them the experience of using ChatGPT to inform their writing and the research. And so I’m not necessarily concerned about the interview. I’ve very recently learned that instead of them describing the process, they can send me a link to the actual interview. So it’s evolved from describing the process to: write an introduction, give me your link, and then write a reflection on what helped and what didn’t help and how you think this is a valuable tool in education, how you think that ChatGPT could derail you in your education. And so I know a lot of English faculty are very wary of AI in the classroom with good reason, because I’ve gotten a few of those papers. And I’ve probably gotten more than I think, and they’ve gotten under my nose. But it’s like the internet was 20 years ago. It’s a tool that’s not going anywhere. And so it is our responsibility as educators to introduce students to these tools and talk about the ethics of them. And so this is just an opportunity to kind of slip that in. And the feedback I’ve gotten from most students is “Oh, yeah, I got really good information. Some of it wasn’t accurate based on my research. I could tell from the tone of what I was reading that it was robotic, and I definitely wouldn’t want my writing to sound that way. But it was nice to put some ideas in and get some feedback from those ideas. So part one is the annotated bibliography. Part two is the ChatGPT interview. Part three is that final essay, and this semester, I’ve added a part four, because I wasn’t feeling like this assignment was robust enough. And I’ve also been in conversations about UDL, giving students multiple ways to express what they know. And so I actually went into ChatGPT and I put part of my assignment in it. And I asked him to write me guidelines for doing a media presentation. And so now they’re going to have to take what they’ve learned in their essay, or what they’ve written in their essay. And they have to take it a step further and do some kind of a PowerPoint or video or some kind of visual component, so that they can, I guess, bring what they know, it’s not just an essay, but they’re sharing it with the world in some respects, or they have something that they could share with the world. And so this will give me an opportunity to talk about portfolios, ‘cause some nursing students need those kinds of things. I know I did when I was in public relations, journalism was my major. And so I know when I got out of college, I needed a portfolio. And so this is just another opportunity for them to maybe have a little bit of fun with the content. And it brings them more into the 21st century. Our students, I’m sure many of them aspire to be influencers. They love their YouTube. So this is a way for them to live out that dream a little bit.

Rebecca: Sounds like an opportunity to think about audience as well.

Jeanne: Yes, definitely.

Rebecca: How have your students responded to these opportunities in the reconfiguring of this project?

Jeanne: They have responded really well, especially with this particular project, the feedback I’ve gotten is I really appreciated the opportunity to research something I need to know about anyway. And I appreciated that you created an assignment that I can relate to, that means something to me. Not every discipline can do that. But as a writing instructor, Comp 101, Comp 102, I do have a lot of flexibility with the content. And so I focus very much on the skills that students can attain… the Siskel and Ebert, they all are looking at me, like, I’m crazy for asking them to create this podcast. But as they go through the process, I give them a lot of time in class. And as they go through the process of creating the document, at the end of the day, they have another piece of writing that they’re really proud of. A lot of them say “I had fun doing this.” And I feel like if a student is having fun doing a writing assignment, I’m really going to get to see their best efforts. I find that a lot of kids come out of high school and they come to college with this idea that I have to write what my teacher wants me to write. And I have to figure out what that is. And during the pandemic, I really got a taste of that when I was helping my son with his research paper, because he didn’t really do any writing. He started by looking for quotes. And then he explained what those quotes meant. He started with main ideas, and then he’d find quotes, and then he’d explain the quotes. And then he’d slap in a bunch of transitions and call that a paper. But there was really no like, “What do I think about this?” It was more about how do I meet all the criteria that my instructors have given me to complete this assignment. And so it’s a real privilege in English 101 to be able to kind of deprogram that thinking and give students the opportunity to really know what it’s like to write what they think,

Rebecca: Maybe to move on from just efficient solutions to things to something that’s actually valuable to them.

Jeanne: Exactly. And they’re learning skills in high school for a reason. They just lack the opportunity to really put those skills together in a lot of regular classes, I think. It’s been my experience with my kids anyway, and with my students, that they are really just re-imagining graphic organizers and presenting them to their students with all the boxes checked.

John: In your professional development role have some of the techniques that you’ve been using been widely adopted at your institutions?

Jeanne: Well, at Waubonsee, they pay for faculty to take the ACUE courses, which is a certificate in effective college instruction. And I know that there are a lot of active learning modules, there’s modules that have to do with creating a classroom environment that is conducive to learning. And there’s also a course that’s separate from the effective college instruction that is fostering a culture of belonging. And so that is a really good course to get people thinking about those around them. And at College DuPage, I do a lot of book clubs. So that’s how I got introduced to Thomas Tobin’s work, Reach Everyone, Teach Everyone and Flower Darby’s work with Small Teaching Online. And in fact, Thomas is the one who introduced me to John, at one of his sessions. So I’m a little bit of a Thomas Tobin groupie, I guess. And so I do find that any opportunity for faculty to engage with each other is really key. I know this as an online faculty member, I know this as an adjunct faculty member. I probably spent a good 10 years in a silo while I was raising my kids, and developed very slowly as an instructor, because I was really just doing my own research and learning my own things. But bringing it out into the world and engaging with other people, it really does improve your teaching strategies and your abilities at a much faster rate. And so I have really enjoyed the privilege of working in faculty development and sharing the things that I’ve learned with others and constantly also learning from others.

Rebecca: That is one of the benefits to being in faculty development, is getting the opportunity to learn new things, and from other faculty and other developers on a regular basis. I think that’s one of the reasons why John and I like to do the podcast. [LAUGHTER] And that’s why I enjoy listening to the podcasts, too. I go in these stages where I just listen and listen and listen and listen and listen, and then I burn out and I gotta stop, or I think, “Okay, I’m not listening to another podcast until I apply something from the last one I’ve listened to.” Because you know, when you’re in the car, and you’re just driving around, it can be really easy to think, “Oh, this is great, and then you forget about it.”

John: And that is a bit of an occupational hazard for being a podcaster in this area. Because there’s so many great ideas that we hear from people that it’s really tempting to try to do all of them. And that can be quite overwhelming.

Jeanne: For sure.

Rebecca: So, we do always wrap up by asking: what’s next?

Jeanne: I know and I keep thinking about that. My faculty development job is supposed to end because it’s a two-year fellowship, supposed to end in May. And so what’s next is there has been talk about keeping my fellow Adjunct Faculty Development Coordinator and I on staff. So I guess we’re waiting to figure out as we revamp that department if I will continue in faculty development. But the good news is I love teaching so much. And I love teaching online so much. And one thing that I’ve learned about the anxiety that I have with teaching in face-to-face classes is that I don’t do it enough. And if I do it more, that anxiety dissipates, because I’m in that community. So I don’t know what’s next.

John: Thank you for joining us. It’s been great talking to you again, and we look forward to hearing more about your continued evolution in terms of teaching.

Rebecca: Thank you for sharing your story.

Jeanne: Thank you so much for having me on. This was great.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

333. High Structure STEM Classes

Multiple studies have found that increasing course structure reduces equity gaps and provides benefits to all students. In this episode, Justin Shaffer joins us to discuss several ways to increase structure in STEM classes.

Justin is the Associate Dean for Undergraduate Studies and a Teaching Professor in Chemical and Biological Engineering and in Quantitative Biosciences and Engineering at the Colorado School of Mines. He has taught a variety of both small and large STEM classes in multiple modalities using evidence-based approaches and has won multiple teaching awards as a result of this work. Justin is also an active researcher with 16 peer-reviewed publications and serves as the editor for four STEM education journals. He is the author of a forthcoming book on high-structure course design coming in late 2024 or early 2025 from Macmillan.

Show Notes

Transcript

John: Multiple studies have found that increasing course structure reduces equity gaps and provides benefits to all students. In this episode, we examine several ways to increase structure in STEM classes.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca:Our guest today is Justin Shaffer. Justin is the Associate Dean for Undergraduate Studies and a Teaching Professor in Chemical and Biological Engineering and in Quantitative Biosciences and Engineering at the Colorado School of Mines. He has taught a variety of both small and large STEM classes in multiple modalities using evidence-based approaches and has won multiple teaching awards as a result of this work. Justin is also an active researcher with 16 peer-reviewed publications and serves as the editor for four STEM education journals. He is the author of a forthcoming book on high-structure course design coming in late 2024 or early 2025 from Macmillan. Welcome, Justin.

Justin: Thanks for having me. I’m really excited to talk to you today.

John: We met at the POD conference back in November, and we talked about doing this but we finally got around to actually scheduling it. So thank you for joining us.

Justin: Thank you, John. Yeah, I saw you sitting there at a table by yourself. I knew your face from LinkedIn and I built up the courage to introduce myself and I’m glad I did.

John: Today’s teas are:… Justin, are you drinking any tea?

Justin: I am drinking some tea. I got prepared. It’s from a small little coffee/tea shop in West Middlesex, Pennsylvania. I’m from the near that area in western Pennsylvania. We call it the Shenango Valley and it’s called O’Neill’s and they make lovely Western PA coffees and teas and I just have some nice black tea here. It is that time of day for me that I need some.

Rebecca: Today I have a jasmine green tea, John.

John: Very good, and today I have a Prince of Wales tea, and a peppermint tea because I didn’t have very much to drink today, and my throat was getting really dry in my econometrics class. So I wanted to be well hydrated. [LAUGHTER]

Rebecca: Lots of variety, too. So we’ve invited you here today, Justin, to talk about how you’ve implemented high-structure course design. And for listeners who might be new to the concept, can you talk a little bit about what you mean by high-structure course design?

Justin: Yeah, so just like I’ll tell you all like I tell my students, I didn’t come up with this term. I wish I did. But I’m building off the work of other giants in the field. So as far as I know, the term really came out in the mid-2000s, 5-, 6-, 7-ish range from the University of Washington in Seattle. There’s some pioneering folks, Scott Freeman and Mary Pat Wenderoth in biology and they use this term structure to think about, “Well, how do we scaffold student learning before class, during class, after class, and we’re continuously building as we go up through the three levels.” So pre-class involves some kind of content acquisition, that can be reading your textbook, reading journal articles, watching Khan Academy videos, other sources like that. And then some kind of formative assessment before class because we all know students need a little bit of a carrot there to get some of that work done sometimes, which is totally great, because you give them a lot of chances, sometimes even unlimited attempts… again, formative assessment before class, make sure everyone has the same solid foundation, then you come to class, high-structure course design, just like any good class nowadays should be really rooted in active learning. So we got a lot of activities going on: group work, problem solving, case studies, real-world connections, any kind of flavor you want to do there with your active learning as long as students are engaged. And the big thing here though, is that you’re aligned to what happens before a class. We’re building off what happens before a class, I’m not in class just repeating what happens ahead of time. Rather, I’m using the foundational material students acquire before class, we build that up with another level in class, and then we keep going. And then after class, there’s a bucket there, where students are going to be practicing those skill sets they’ve been developing through the before class and in-class buckets, applying their skills to new contexts, solving new problems, doing projects, essays, more authentic assignments, whatever you want it to be. And then there’s typically a frequent assessment piece with a high-structure course design too, whether that’s a multiple midterm model, weekly quizzes, every other weekly quizzes, things like that, in addition to some more authentic assessments, which is something I’ve tried to get more into this past year, by adding more realistic projects and course assignments in my high-structure courses.

John: Could you give us some examples of some of the authentic assessments that you use in your classes?

Justin: Yeah, thanks, John. So this is really new to me still, this past year. I know I’m behind the curve. I know this is a term has been around there for a while. I always like to think I’ve had some authenticity in my classes for a long time. I integrate news stories, I use case studies, I have this new thing I called pod cases where I take podcasts and combine them with case studies and we use those in the classroom. But I thought I could try to be a little bit more authentic, even still… getting that advice from my wife for my personal life. She always says that can be more authentic. So, maybe I can make my courses and my assessments more authentic too. One example I’m doing right now. I’m teaching introduction to biomedical engineering, and I’m having the students write the actual legit National Science Foundation Graduate Research Fellowship proposal. Those of you familiar with that, there’s a personal statement part and there’s a technical kind of research proposal part. So we’re just doing that. It’s a two-page proposal, and we’re working on this in a structured way throughout the entire semester. Last week, students had to turn in the research topic and research question. This week, they’re turning in their hypothesis, in a couple weeks they’re turning in the literature review and experimental plan. We’re gonna have two rounds of a formal peer review of the entire proposal. And then we’re going to conclude with a mock panel discussion, just like you might have in the real NSF or the real NIH where students are going to be reviewing each other’s proposals and basically pitching them to each other and seeing if they should get, quote, unquote, funded or not. I don’t have any funds for them. Maybe we’ll bring candy on the last couple of days. But that’s kind of the idea of having a real thing that students could actually use some day if they’re going to graduate school. But even if they’re not, being able to write technically and persuasively in two pages on a proposal is a really important skill that they should be working on, in my opinion.

Rebecca: Sounds like you’re going to need some chocolate coins for that day.

Justin: That’s a great idea. I will get chocolate coins. [LAUGHTER] I didn’t think of that. [LAUGHTER]

Rebecca: Can you talk a little bit about what motivated you to attempt and move in the direction of high-structured course design.

Justin: I kind of started out this way, I kind of started in the deep end, if you will. So my postdoctoral program was called spire, S-P-I-R-E, and it’s one of these bigger programs called IRACDA through the NIH. They’re postdocs where you still do research. So I was a molecular biologist, biochemist at the time. I have a weird background in chemical engineering, bioengineering, molecular biology, but at the time, I was studying muscle proteins in squid, super fun stuff. And then I also got training, though, on how to teach evidence-based college science and engineering courses. In my postdoc, through great people like Ed Neil, Brian Ray Bozic, Leslie Lauria, and then also Kelly Hogan was someone that took me under her wing at the time, she was able to, along with the rest of the SPIRE team, helped me be introduced to using evidence-based course design practices, which included with high structure. So this was around 2010-11, right when these papers are starting to come out from Scott Freeman and Mary Pat Wenderoth. I started with high structure because the evidence shows it works. And that’s as a trained scientist, as a trained engineer, we like to go with evidence ideally to guide our decisions. And it’s no different with course design and teaching as it would be with thermodynamics or reactor design or anything else. The literature on high structure is really strong, even then it’s been growing over the years, some of my own data and a lot of other papers. The main gist, though, is that by having the scaffolding before class, in class, after class, students are able to really monitor their learning, develop self-regulated learning skills, be more metacognitive. And the data in a lot of papers shows all students are doing better in the class. But it’s not just everyone, using high structure and moving up in structure will start to close or reduce achievement gaps or performance gaps between historically underperforming students and their majority counterparts. So for example, female students and male students in physics, there has traditionally been a gap there, add some more structure to the class, those gaps tend to get smaller. And I’ve been participating in that kind of research here over the last many years with undergraduate students and my research team. And we found some similar results across different STEM disciplines. It’s really the evidence guiding me in these decisions to do it. I also think it’s a lot more fun. Once I have in mind one of my very first faculty interviews, oh a long time ago, now, I had an interviewer say to me, “Well, hey, I’ve looked at all the papers on active learning, and they’re all wrong. [LAUGHTER] All the statistics are wrong. What do you have to say about that?” And I paused for a second I said, “Well, even if that’s true, it’s a heck of a lot more fun to teach actively with active learning than not, I think the high-structure design model is more of a fun way to teach. And again, you’re helping the students with those study skills and metacognitive skills that they can then take forward to their future classes.”

John: There was a recent paper that did argue that many of the studies on active learning were flawed in some way in terms of a very strict methodological approach. However, there are so many of them, and the results are so remarkably consistent. I don’t really buy that argument in terms of the questions about methodology.

Justin: You’re right, it was a big deal, I think it was either Beckie Supiano or Beth McMurtrie in the Chronicle had articles on this going around for sure. And that’s the thing though, with us, as DBER folks… I want to introduce a new term, DBER – discipline-based education researchers… which I consider myself to be in. So I’m in the discipline. I’m in chemical engineering, I’m in biology, I’m in Biomedical Engineering, and I do the education research from that lens, but also from that training background. I’ve never been formally trained in education research methods in psychology or social sciences or psychometrics. I am, totally honest, I fake it. I do what I can. I know my boundaries. I know when I need a collaborator in the true social science disciplines that helped me with my studies. And so I think that paper was getting some of that. Sometimes the folks like us that are doing this work, whether we call ourselves DBER people, or Scholarship of Teaching and Learning (SOTL) people, we might not have that true background, and therefore the rigor of the paper, the methodologies, aren’t as advanced as maybe they should be. But like you said, there’s so many studies showing benefits of this, whether it’s simple correlational studies… sometimes they get to the mixed methods, even quasi-experimental studies, but the evidence just keeps mounting and mounting and mounting. And that key paper there was the 2014 one from Scott Freeman that PNAS meta-analysis showing that hundreds of papers, hundreds of studies… again, they have their flaws, don’t get me wrong… but you start to see these themes everywhere and you think, well, there must be an effect, something’s going on.

John: And we will include a link to that paper in the show notes, if anyone would like to follow up. But the fact that there may be these flaws in some of the research methodology suggests that maybe we need to see more people doing work in this area, and that there’s a lot of areas where there’s potential growth.

Justin: Totally agree.

John: And you’ve done quite a bit of research already.

Justin: I’ve tried, as a teaching faculty member now for this is going on year 12-ish, but I’ve always made that a part of my career. Before I was at Mines, I was at University of California, Irvine, where we did have a scholarship expectation or to earn tenure as teaching faculty. The UC system is one of the few in the country where you have actually tenure-stream teaching faculty, which was really cool. So I earned that, but I only had tenure about a month because then I left and came to Colorado, which… no regrets, I love it here at Mines… but I don’t have tenure here. But there’s still some expectations for scholarship, but not as high as it was in the California system. But I continue to make that part of my career, because, again, as a scientist and engineer, I think going based on data, based on evidence to guide your decisions, moving forward is a really important thing to improve what you have, because that’s all it comes down to really whether you call it SOTL or DBER or whatever, we’re trying to improve our courses, we’re trying to improve our students’ experiences. And yeah, so I’ve tried to do what I can over the years. And now I’m at the point where I want to help other people too. So I work with faculty individually, I do workshops via my side business, and even at Mines this semester, starting next week, I have a three-part getting started in DBER series kicking off for about 25 faculty on campus. I’m going to help them get started, get their feet wet in this field, and then we’ll see where it goes. Because I think a lot of folks, like you said, John, want to do this work, they’re interested in it, they might not have the time, they might not know how to, but you kind of give them the start, hold their hand a little bit and then see where it goes, and we’ll get even more evidence to support these claims.

Rebecca: I think a lot of faculty have an inclination to have a reflective practice and continuous improvement. They’re wanting to do SOTL work, but just don’t know how to formalize that practice. And we can certainly lean into helping people move in that direction.

Justin: 100% Rebecca, even when I started, I didn’t know what I was doing. If it wasn’t for Kelly Hogan and a few other folks at Carolina and then moving on from there at UC Irvine folks like Brian Sato, Diane O’Dowd, Adrianne Williams, they really helped me understand the field more. And then you start going to conferences and going to meetings and learning more about the tricks of the trades.

Rebecca: Can you talk a little bit about ways that a high-structure synchronous course might be different from a high-structure asynchronous course?

Justin: So I think the high structure while what I described earlier, you might be thinking of okay, a Monday, Wednesday, Friday class meeting at two o’clock in a lecture hall works great. I think it works even better in online for some cases, because you think about an online situation, whether again, it’s synchronous or asynchronous, your students you’re not really seeing and there’s that human connection of having eyeball to eyeball being able to understand, “Okay, I’m here I’m motivated, I’m ready to learn.” But whether it’s the recording, that’s the worst case scenario, when it’s totally up to you, or if it’s going to be on that live Zoom remote, where you can make your screen black, and who knows what else you’re doing. I’m guilty of that in meetings for sure. But having the structure though, having that scaffolding, having the clear deliverables of what is due when and seeing that step up from pre-class, in-class, after class, whether it’s the in-class is out again, synchronous Zoom session, or the recorded video you do on your own time, there’s that scaffolding helps students stay more connected with material, they understand more of what’s going on, when it’s due, what is due, how I’m being assessed, because that’s the nice thing about with structure. And just to be clear, I’m from the STEM disciplines, but you could do this any field. The research on high structure, as far as I know, is only been published in the STEM fields. I bet it’s being done in art history, I bet it’s being done in the languages, I just don’t know about it. So if anyone listening does this kind of teaching or research, I’d love to hear from you. But you can use that scaffolding again to help students be more transparent with the course. And that’s a word that I think comes through with high structure and is really true in that online environment, especially as transparency. I always tell my students, I want to know what you know, not what you think I want you to know. And by being uber clear with the learning objectives, starting with backwards design, just a clear Canvas website for the online cases can be really helpful for that. One distinction, though, with the async online versus synchronous online, is that kind of active learning piece, because we’re not there together. So one tip I like to share with faculty is that okay, if you’re recording a video for the in class, mimic, because you’re not actually meeting in class. What I always say is “okay, well make the video, but if there’s a point where you’d want them to answer a clicker question… I’m a big clicker guy… or if you want them to do an activity, just say, Okay, everyone, pause the video here. Take a couple minutes, think about this problem, what’s the answer or work on this, whatever it might be. When you’re ready, unpause the video and keep going. That’s a way that you can add the active learning to an online asynchronous class as part of the bigger high-structure model. I find when I have to record an online video, if I have traveling for a conference because I have to miss a day of class. I’ll have a 50 minute in-person class, when I make the video recording it’s only about 20 to 25 minutes, because all the active learning I don’t do in the video recording, but I give that tip… I tell my students, hey, pause the video here, answer this quick clicker question, solve this problem, come back when you’re ready. And so that’s a way to build the active learning into the asynchronous part, which again, is part of the overall high-structure piece.

John: And also, if you want to take it a little bit beyond that, you could use one of the tools where you can embed the questions directly in the video, and have them auto graded. I use PlayPosit for that, and it’s possible in Panopto, and EdPuzzle is another alternative that many people use. PlayPosit works really well. And I’ve been using it for a couple of years.

Justin: I just learned about PlayPosit maybe three weeks ago, I was doing a workshop at CU Boulder on clickers. And I kept hearing PlayPosit, it does seem like a very powerful tool to automate that active learning in the video piece, which I really like. I just haven’t had a chance to play with it.

Rebecca: So you did just mention that you’re a clicker guy, I believe. So do you use a flipped classroom approach in all of your synchronous classes? And how are you using clickers in your classes?

Justin: Yeah, I think that’s the technical term these days, clicker guy. So, I’ll go with that. I’ve been using them for as long as I’ve been teaching in various platforms. You name the platform, I’ve used it. I’ve primarily been using iClicker, just because that was the platform we had at UC Irvine and the platform we have here at Mines as well. Yes, I love using them. I think it’s really important. And you mentioned the flipped classroom design there, too, Rebecca. So when you think of high structure, you might think, “Oh, it sounds like a flipped classroom.” And it kind of is because we’re having students do stuff ahead of time. In class, they’re very active, but there’s still that structure piece even within class. I guess maybe I haven’t seen a truly flipped class because I think flipped classes, I think in class is like purely work time, purely activities, purely worksheets, homework type assignments, whereas I do a series of clicker questions, discussions before or after numerical problem solving, if it’s more of my engineering classes that I teach in thermodynamics, or material and energy balances, more conceptual sometimes if it’s biology or anatomy and physiology, but I’m breaking up a lot of activities and any talking with clickers. And so the clickers… I love all the modern bells and whistles that they have as that’s the another technical term I use, moving beyond multiple choice. And when I do workshops for faculty with clickers, that’s what I triy to get them to do. Okay, yes, you know, you can do A B C D E, but can you do multiple answers? Can you do target questions or hotspot where you touch the screen? Can you do ranking or ordering? numerical answers? …and I’m trying to get this traction on my own campus too. So even this semester, my first five questions of the semester, which I didn’t do intentionally, but after I wrote them, I realized, oh, I should do this every class now… my first five questions in my introduction to biomedical engineering class, each one was a different question type. So we did multiple choice, we did multiple answers, we did short answer, text entry, we did numerical, and we did target or touch the screen. And when I was done, I asked my students, “Hey, who’s ever used those other question types before?” And maybe four hands went up, I said, “Cool. What class did you do them in?” and they said, “Oh, your class last semester.” I seem to be the one and only that I know of on my campus that’s trying out these other tools, although like I said, I’m trying to change that. So yeah, if you’re using any kind of device like this, any type of ed tech, for that matter, make sure you justify it, justify the cost, and you make use of those bells and whistles in class. Or if it’s out of class, courseware, whatever it might be, just make good use of the tool, and you’ll find your students that are going to be able to buy into it and use it more effectively, and hopefully learn more from it.

John: And one option that we have here is a campus license, which actually is much less costly per student. And that reduces that barrier of students having to pay for it, which has led to a pretty rapid expansion in the use of it on campus.

Rebecca: One of the things that I really like about your example of the five questions is that extra level of scaffolding, of introducing all of the question types right away, and giving everybody an opportunity to practice those question types that you’re going to be using all semester. And so I just wanted to make explicit that other layer of scaffolding that you have built in there.

Justin: Yes, teaching students how to use the tools is very important. Thanks, Rebecca, for mentioning that, because whether it’s the app now on your phone for these clicker devices, or if it was the old physical device, there’s a learning curve with them. And same thing, even if it’s computational tool, or like Desmos, or something for a calc class. Yeah, you got to be able to teach students how to use the technology properly first, before you expect them to use it well. I will say though, with the learning curve of the clickers, when I was at Irvine, the app wasn’t really there yet. So everyone had the physical iClicker remote, and this was the iClicker w, so you could do text entry, and you could do number entry, but you had these up and down arrows, which you had to click to go through the alphabet. So I do the type of clicker question where I like to give four statements on the screen, and I say, “Okay, well tell me if they’re true or false, and you have to click in all four.” So you would click in a string of T’s and F, so it’s like TTFT, or FFFT, whatever it might be. And so when I would do this in intro bio there with 440 students, it sounds like a swarm of locusts, all the clicking to get to the T’s and then someone says, oh, you should change it. Just make A be true and B be false? I said “Great idea, I’ll do that.” But now with the app, we lose the sound effects and iyou can just type in T’s and F’s and it’s a little bit easier to use.

John: One thing I haven’t tried with iClicker, and I do plan to do it this semester is allowing students to rate their confidence in their answers. Have you tried that yet?

Justin: I did just last week. So I just found out that was available this semester, and I gave it a shot. And it was kind of fun. Like the first day I turned it on, they’re like, Oh, look at this, this question was 80% confident, and now it’s down to 40% confident and it kinda reflected the percent answers that were correct. So like the one that was 80% confident it was a single multiple choice answer. And it was pretty much most people got it right. The one that was lower confidence, like 40%, was a multiple select answer. So they had five options, but two or three could have been correct. And so the confidence goes way down through a different question types even. So, I think it was really fun for a day or two, and then kind of the novelty wore off, unfortunately. [LAUGHTER] So I’m going to try to revisit it maybe more in targeted times and targeted questions rather than doing it for every single one. But it was fun to try it. I’d encourage you to do it, too.

John: One of the reasons I was considering it is that it might help students improve their metacognition a little bit by reflecting on how well they thought they knew something and then getting fairly immediate feedback on whether their expectations about how well they knew it actually matched the response, [LAUGHTER] or the feedback to the response.

Justin: Absolutely.

Rebecca: When you’re using clickers, are you also using strategies like think-pair-share as part of your implementation?

Justin: Yeah, absolutely. And there’s that sweet spot of clicker responses that lead to that. So the best practices, I’d say, and a lot of this work came from Carl Wieman Science Education Institute, which I believe is still housed through Vancouver, British Columbia, but he’s at Stanford now. But there’s this great flyer they made like this trifold flyer that kind of walks you through how to use clickers properly, or best practices suggested, and then what are the possible outcomes? Typically, you’d start off with that silence. Okay, click in on your own at first, I tell them I want to hear crickets, just click in by yourself, and then I’m able to see on the app the distribution and so at that point, there’s typically kind of three outcomes. So one is maybe 80-90% have the correct answer. At that point I’ll say “Okay, let’s move on.” But I make sure to take time to have students respond and say, “Okay, well, why is it C?” or to have a little discussion about why it’s not the other answers. Because even though you get 90% correct, there’s still 10% of students who got it wrong. So we want to make sure that everyone’s on the same board. The next option is usually that kind of random distribution. Let’s say if it’s a multiple choice question, you get ABCD each are in the 20 to 30% range. At that point, I call that Hmmm, what’s going on? Was it a really hard question? Did I goof the question? Is there a chemistry exam this evening, so there’s some reason why maybe it didn’t click? And then what I call the Goldilocks case is when you get the kind of 50-50. So maybe you’re split between two answers. And I love actually, when it’s exactly 50-50, I’ll show that on the screen. But sometimes I don’t, and I’ll say “Okay, at this point, now, you’ve all had a chance to try on your own, now talk to each other.” So that’s kind of the think-pair-share that’s built into the clicker there. So this is peer instruction at its best. This was pioneered by Eric Mazur at Harvard, people like Jenny Knight at CU Boulder have studied this. And she actually has a Science paper with Carl and a few others that showed when students are doing this… So you give them some quick information on their own. Don’t show them the answer, have them talk to each other. They put a bunch of microphones around the lecture halls at CU Boulder, and they listened into their conversations. And they actually found students are legitimately teaching each other and debriefing the topic, discussing it, tearing it apart. It’s not just the one student says, “Oh, it’s A ,everyone else, click A.” They’re actually debating it and talking about it, so that you get that true peer teaching and peer instruction going on. And then typically, you see everyone moving more towards the positive correct response that you’re looking for, at which point you can say, “Hey, look, you don’t need me as your instructor, you’re teaching each other. You’re doing great. Kudos, keep up the good work.” Yeah, there’s so many ways to riff on clickers and use them in different respects. Whether it’s the more traditional question types, or now the more advanced question types, and no matter how you do it, you’re getting students more engaged, they’re having more fun with it. And fun actually is a word they use with clickers. I have a paper a few years ago from the HABS educator where I looked at clickers vs. Kahoot!s, and students rated Kahoot! and clickers both equally fun, where Kahoot! being the more gamified version with trophies and a podium and music and sound and stuff like that.

John: And both Eric Mazur and Carl Wieman and some co-authors had done some experiments on the use of clickers with that methodology with answering it individually and then discussing it and voting again. And they found some really substantial learning gains in both of those studies. And we’ll include links to those in the show notes. In all areas, we’ve been seeing some significant equity gaps, but I think since COVID, we’ve been seeing much worse equity gaps in terms of students because learning losses were pretty pronounced everywhere. And that’s especially in math and in the STEM fields, but they were especially large in lower-income communities where schools were not as well funded and where students did not have the equipment and so forth, needed to thrive as effectively in remote instruction. One of the things that some institutions have been using increasingly is co-requisites in place of prerequisites to help students who want to pursue a major in a STEM field, but who would otherwise fall way behind or take many years just to get up to the basic level of math needed for the entry level courses in the discipline. In 2021, though, you had done a study that did a comparison between the effects of prerequisites and co-requisites. Could you talk a little bit about that study and what you found?

Justin: Yeah, absolutely. We saw the same thing probably everyone else did with students struggling, returning from online instruction in high school and having online instruction here. I taught remote synchronous for three full semesters, even though at Mines we stayed open for business pretty much the whole time with in-person classes, just lower capacity. I had prior online instructional experience in my career, so I volunteered to do those online sections for our department. But with the co-rec/prereq issue, I think that’s really important to consider for a lot of reasons. And this work really started when I was at Irvine with Brian Sato and Pavan Kadandale and a few others, looking more in the biological sciences and “do prereqs matter?” It was kind of our big research question. And then I carried that over to Mines and applied that to chemical engineering too. The short answer is: it depends. So first of all, and kind of why do we even have prereqs or co-reqs? A lot of it seems to be more of a management thing. So if we want to control class sizes, moving from first year to second year, and so on, and so forth. But there’s definitely an idea of well conceptual understanding and carry forward for if you have Bio I, well, those skills you develop could be used and count for something when you get to Bio II or same thing with the calc series or whatever it might be. However, we don’t know. It’s unfortunate that I think programs don’t sometimes look at those connections, that vertical alignment, if you will, between courses in terms of prereq to the following class, or with the co-req issues. At Mines, what I did with the paper you’re referencing, John, in chemical engineering, we have these two courses. One is called material and energy balances, MEB, I’ll call it for short. And that’s kind of like our intro bio version for chemical engineering. It’s kind of like a survey course that covers a lot of different topics, gives you some foundational skills that you’re going to need as a chemical engineer. We also have introductory thermodynamics, and an intro thermo, it’s related to MEB, covers some same conceptual understanding and problem-solving skill development, but it’s more on the nature of energy, and that transformation understanding. So typically in chemical engineering curricula, and I’m getting in the weeds here, so apologies for anyone who’s tuning out cuz you’re not a chemie, but MEB comes first, that’s typically either the fall of sophomore or spring of sophomore, you take that. First, it’s kind of like your gateway class, and then that’s a prereq to intro thermo and everything else you take. At Mines though, we do a little bit different. Mines, we do intro thermo first, fall of sophomore year, and then in the spring of sophomore year, you take MEB and coming from that background myself as a student at Penn State, I wish I would have had that way because intro thermo is the more… I use the word gentle… it’s a gentler introduction to chemical engineering than material energy balances is. But the idea here is that you can take thermo as a prereq in the fall or as a co-req in the spring with MEB. So the natural question came up… it’s a nicely well organic experiment to test is, well, if you have the thermo as the prereq do you do better than if you take thermo as a co-req with MEB. And this has implications for advising and its implications for progression through our major through repeating classes, all sorts of things. So it’s a really worthy study and my student, Jordan Lopez, at the time, he was an undergraduate student in mechanical engineering, and I love working with undergraduates on these SOTL and DBER projects. Jordan came along with me for this we did a quantitative assessment to figure out okay, well if students in MEB, did you have thermo as a prereq or co-req? How’d you do in MEB? And then we also asked the students qualitatively “Okay, well, do you think having thermo as a prereq or co-req matters? And if so, what do you think? And what we found was there was actually a big deal. Students who took thermo as the prereq did significantly better in their overall course performance in MEB than if they took thermo as a co-req, and that’s using linear regression models controlling for incoming GPA and things like that. Students also felt the same way. They felt that if you have thermo as a prereq, you would do better than having thermo as the co-req with MEB, and again, the quantitative data bore that out. The reasons they gave for that was because they get some opportunity to get more familiar with the discipline, with how we approach chemical engineering, how we do problem-solving skills, and having that foundation in the prior class allows them to do better in the follow up MEB course. In this case, it mattered, prereq vs. co-req. However, in our studies at Irvine, with Brian and Pavan and others, we found it didn’t really matter so much whether you took for example, microbiology lecture before after microbiology lab, you would think those two would be highly correlated one as a prereq to the other, it didn’t really matter in the result. Same thing with anatomy and physiology sequences, it didn’t seem to matter too much, in other papers in which we cite in these studies looking at organic chemistry sequences, economic sequences, it’s kind of hit or miss with whether prereqs matter or not. Long-winded segment here, but I think we as programs should be taking careful look at our prereq sequences and core sequences in general to see what, if anything, our students carrying over from one course to the other, and maybe we should loosen that up a little bit, because if they don’t matter, that can help students be a little bit more flexible with their degree planning, and time to graduation and things like that.

Rebecca: Speaking of prerequisites, faculty are often complaining that students don’t necessarily recall [LAUGHTER] information from prerequisites as they go into a sequence like we might expect. In 2018, you conducted a study that investigated the effect of physiology prerequisites on the future anatomy and physiology courses. Can you talk a little bit about that study and what you found there?

Justin: Yeah, so that was what I was alluding to there, Rebecca, with some of the work I did with Brian and Pavan. And in those cases, there wasn’t too strong of an effect, if anything, with the sequencing and the ordering that students took these classes. At Irvine, we did have human physiology as a prereq to human anatomy. I know that sounds a little funny to those of you in the A&P space. But the reason we did that was because of kind of a controlling the size of things. Our physiology course there was a lecture-based course, it would have 3-4 hundred students in it every quarter… talking about over 1000 students a year taking this class, versus the anatomy class, which had a lab, we can only handle about 144 per quarter, so availability of seats in the human anatomy was much, much lower than physiology, and also not as many students wanted to take anatomy versus physiology. So that’s kind of why that ordering existed. And so we tested that, though, looking at with what Brian and Pavan and I came up with, we call it a familiarity scale. How do you do on questions that are based on how familiar you are with the content based on the prereq? What we did was we had the prereq instructors look at the follow up course exam questions and write them as very familiar or not familiar based on basically whether it was covered or not. And then we looked at student performance on those questions based on having the prereq or not, and we didn’t see much of a difference based on the very familiar versus not familiar questions. The way we designed those studies, we didn’t come up with any strong conclusions, again, on the biological sciences side saying that, yeah, these prereq sequences matter. But on the chemical engineering side, which I just described, that seemed to totally make a difference, the ordering of the classes.

Rebecca: It seems like it’s really important to think about why we’re structuring the curriculum in the way that we are. And is it just traffic control? Or is there actually a legitimate reason why we’re hoping that they are scaffolded in the discipline?

Justin: Yeah, I think it’s reality, a little bit of both that happens, which makes sense, kind of have that traffic control, but also making sure that that alignment occurs through our new programs or existing programs, and just taking the time as a program or department every so often to say, hey, let’s look back at this and see, why are we doing it this way? Things need to change in this modern day.

John: One thing I wonder a little bit, though, when instructors are complaining about how little students remember from the prerequisite courses that they’ve taken earlier, is how much of that may be due to the incentives provided to students. The way many courses are structured, not in the sense of the structure you were talking about, encourages students to do a lot of cramming before the high-stakes exams. And we know that that results in very little long-term recall. Might some of these issues be resolved if we could encourage students to adopt better learning strategies, and if we could design some of our courses at the lower level, perhaps, to build that in, using the type of structure that you’ve been talking about? Because at least from what I’ve seen, that’s not so common? You picked up this stuff fairly early, but I don’t think that’s part of the training of most of the faculty in STEM fields or in most disciplines.

Justin: Yeah, I agree with that. And there was even in 2018, I believe, in Science, a paper, I think they call it “The Anatomy of STEM Education in North America,” it was something along those lines, where they looked at a big survey a big swath of courses and trying to see who’s using Active Learning who’s not, they use the COPUS protocol, the observation tool to characterize what’s happening in the classroom, and they broke it down in these seven different buckets. And even at that time, a very small percentage of the courses surveyed in STEM were taught using these student-centered strategies, not necessarily high structure, but the active learning, student-centered ideas. But I completely agree with you, John, if we can get more faculty on board with using these types of evidence-based practices, which yes, it takes some time, takes some energy, takes some foresight to develop these courses. But you do the same thing with your research, it takes your time and energy and careful thought to put in your research experiments. We should put the same energy into our classes too. And if we can do that at the early stage, which again, there’s such a huge issue with loss of learning. Not only that, but also lots of students from the early stage. There’s a paper after paper for these bigger courses, taking them as quote unquote gateway classes, we get a lot of attrition at these levels especially of students who might not be as well represented in STEM. We can add high structure. We know that works. We know that helps students do better and succeed. It might not work the first time, don’t get frustrated everyone. There’s a great paper from Anne Casper and Scott Freeman about having True Grit with being able to try and try again. So in her case, she tried adopting high structure at a smaller school in Michigan, it took her about three tries to get the right formula for it to work for her students to see success. And that paper documents that trial and error over a few semesters. But if we can use these types of methods in our classes, ideally, our students are going to be better prepared then for future classes. I do these things called Reading guides, which again, another shout out to Kelly, I got a lot of inspiration from her at Carolina for these, these are just Word documents that I make. And I have a bunch of these on my professional website. If anyone’s interested to download them for free, go for it. They’re just Word documents that help students read the textbook and again be more transparent with what I want them to know. So it has them define terms, fill out tables, make little drawings, they answer checkpoint questions in the text, summarizing things in their own words. And with the reading guides, we’re able to help students again acquire that content and then use it in the class as needed. I’ve had students in follow-up classes say to their instructor, “Well, where the reading guides at?” And they’ll come to me like, “Hey, what are these things? What are they talking about?” So the point being with that story, though, is that I tell students that “Hey, even if you go to a follow-up class, where it’s not highly structured, you’ve developed so many great metacognitive skills, you’ve developed so many great self-regulated learning skills through this class that you can then apply it and add your own structure to follow-up classes, if needed. And these are the kinds of tips that I love working with faculty about to try to help them transform their classes when I visit a campus and do a workshop or work with faculty one on one or on Zoom or whatever, trying to take these practices, which again, are rooted in the evidence, they’re rooted in the literature, but we have to tweak them to your own personal situation, your own student body, your own courses and demographics and everything. You all know your students way better than I do. What I try to do is combine what I know from the literature and the evidence. And that says a lot of this is in the book I’m writing on high structure, it’s going to guide you through the course-design process, a lot of practical outcomes and deliverables. But you got to tweak it and match it with again, your unique circumstances to achieve those positive outcomes.

Rebecca: I think one of the nice things about introducing students to some strategies for high-structured learning and retaining information is that if you have things like your reading guide, and they show it to another instructor, now they might request that of their instructor and the other instructor might decide, “Hey, this is a good idea. This is a strategy I want to adopt too.” And that’s some of the best ways to get some of these techniques to spread.

Justin: It really is. It’s that camaraderie building through seeing each other’s practices, seeing what’s going on. I’ve been part of a project here at Mines since I got here almost six years ago now where we’ve been working on kind of revising how we evaluate, and what we consider effective instruction to be. So we’re trying to take a more holistic review of how we take into account the best practices of teaching and student learning. And one of the big pieces there is peer observation. So we’re actually rolling that out, as of this week and last week with doing departmental trainings and helping faculty see how we can do peer observation to learn from each other. I learned so much from going into another person’s classroom or looking at their Canvas site, or their syllabi or their materials. And I really got this from Malcolm Campbell, who was at Davidson College in North Carolina, when I was a postdoc, this is going back 14 years or so. And Malcolm told me once on the phone, he said, “Find someone who you consider to be a master teacher, and go watch him teach.” But he said “don’t go just once, go a lot. Once a week, if you can for several weeks, and you’ll get to see them handle different situations, you get to see the ups and downs of the semester, you get to see what it’s like on the day where the midterm gets passed back. Or you get to see what it’s like when they’re getting to a really difficult topic or there’s some kind of disruption that class and how they handle it.” That’s the one great thing about peer observation is that if I go to your classes, sure, I’ll be able to give you some comments or feedback on what I saw, but I’m going to learn probably more from seeing you two teach than whatever I could give you and then I’m able to incorporate that into some of my lessons and my teaching style. If we can just change that culture, make it a little bit more okay sometimes to talk about teaching, share teaching strategies, see each other teach and have fun with it really and learn from each other, I think that can go a long ways towards, again, improving student outcomes and helping them do better in all aspects of college and life.

Rebecca: I found one of the most fun opportunities for observations is doing observations outside of your own discipline. It’s really informative to see how people in wildly different disciplines approach teaching and the way that they operate their classroom. I remember visiting a dance instruction classroom when I was at Marymount, at my prior institution, and it was really interesting, it was fascinating to me about how specific and transparent every little move was and how to correct things and the anatomy that was being discussed and just the level of depth that you might not realize how something transpires in a classroom unless you’ve actually had the opportunity to observe it.

Justin: I’m going to play that some for my faculty Rebecca. I thank you, because that’s what we’re trying to do at Mines is not intra-departmental, but rather inter-departmental observation. So getting across the disciplines for sure. Because yeah, you learn so many different things. And even if you’re just going from mechanical to electrical engineering, there’s still a lot of differences between those types of courses, you might see what’s going on. And I’ve learned that myself, I’ve watched some economics instructors teach at Mines, no idea. I feel like I maybe should know this stuff to be a better financially literate person myself, but I learned so many cool ways about how they’re teaching, but I also learned some cool concepts.

John: We do have an open classroom project here on our campus, we keep hoping more people will open their classes and more people will attend. But the people who have participated have found it universally to be valuable. So we’re going to keep doing it, and we just hope to see it become more a part of the culture.

Rebecca: Sometimes just indicating to a faculty member that you’re interested in their content, and you just want to sit in because you’re curious is a great way to learn new content, and maybe get an opportunity to observe someone teaching. [LAUGHTER]

Justin: And yeah, I definitely pitch it that way. Like I want to learn from you. And you get some new ideas. And I feel like in that case, faculty are more than willing to have you in. Well, yeah, Best of luck with that open classroom project. I’ve seen those types of programs in the country kind of sometimes hit sometimes miss. But best of luck with that.

John: One of the things you’ve done is just some research or some experiments involving two-stage exams. Could you talk a little bit about how you implement them, and what you found in general? And how did students react to the two-stage exams?

Justin: Yes, so I’ll try to be brief on these because I could spend probably 45 minutes on these myself. But yeah, two-stage collaborative exams, or more affectionately called group quizzes or group exams for short. There’s been a ton of literature on this Jim Cook, UC San Diego, he really helped me get started in this about five years or so now. But it’s all disciplines. You look it up, and the one paper I have, you mentioned in the intro, there’s a lot of references to different STEM disciplines that use them and some non-STEM too. The idea, though, is that we push active learning, we push group work, we push collaboration, but then we assess you by yourself with a pencil and paper and a calculator on a piece of paper, so why not change the dynamic there a little bit. And the two-stage idea is that first you have students take an individual quiz or individual exam, and I personally have gone to a weekly quiz model with my high-structure courses. I don’t do midterms anymore, I don’t do finals sometimes even. I know that’s taboo sometimes, but it depends on the class and I might not even do that. My colleague in Irvine Adrienne Williams says with high structure by going to the weekly quiz model, instead of having these giant peaks of anxiety with the two or three midterms, we just have a smooth level of anxiety the entire semester, and spread it out a little bit. But, for me, group quizzes then, what they look like is students take the individual quiz, turn it in, then they get in a group, this is a predetermined group, they know who their group is going to be. And then I give them a group quiz. That group quiz in the paper that you referenced was an identical one. So they took the identical two problems. And this was a MEB material energy balance class. So it was just two numerical problems, problem solving. They did that again as a group. However, my other courses now I do a different quiz. It’s either an isomorphic question, so slightly similar, but a little bit different, maybe in intro thermo or if it’s biology or anatomy and physiology, completely different set of questions. Then they do it as a group. The reason we do this, again, was trying to get this collaborative piece in the group setting. But also, when do you find students are most excited to talk about a quiz or an exam? It’s as soon as it’s over, they go walk out, the hallways abuzz, everyone’s all excited, good or bad excited, but they’re talking. So let’s capture that energy and do it in the classroom through that group assignment. Now, the group quiz is usually a fraction of the weight. In the literature, you’ll see, it’s usually let’s say you call the whole experience 100%, the individual quiz, maybe 80%, the group quiz is 20%. But that can vary from 75 up to 95, however you want to do it. And again, they’re covering the same kind of concepts just in that group dynamic. And so when I did this the first time, I got some consultations from my co-instructors, Rachel Morrish, Dave Marr at Mines, and I was a little bit nervous to see how it would go. But it was a hit. It was an absolute blast. The energy in the room is one thing I cannot describe it strongly enough here through audio, it’s just you got to see it. The students are energized, they’re talking, they’re debating. They’re working through the problems together. They’re trying to figure out, I will use the F word here. It is fun. It is a very fun experience to see. I’ve had students tell me that after the quiz is over, like that was a lot of fun. Talking about spreading things on campus. This is one thing that has spread a little bit at least within my department of chemical engineering, a few other classes have been using them now. And I collected some data on this, which I published, showing that… which makes sense, there was no shock… but the group quiz score is higher than the individual score because you’re tackling this together right away. And then also though, students strongly preferred it. The affect, the positive attitude response was through the roof. Both of those results, these are replicated from other disciplines, they see the same kind of things. I think it’s a really nice way to promote that community in the class, show that you’re working together, add that active part to the assessment. However, I’ll end with saying there can be some resistance to this, especially from students who might feel like “hey, I can do it all on my own, I’m fine.” And then they have to work together with maybe some students, they don’t know as well. You might get some resistance from students saying that I don’t want to work with someone else, I wanted this on my own. So be prepared for that. Also, accommodations with testing, if you have students who get extra time, that can be difficult to manage. I will say though, from doing this now about five years and four different classes at Mines, I’ve never had a single issue with students and extra time. What I typically do is I’ll have students get the extra time for the individual part, then they come join us for the group part and have the normal amount of time because in that group setting the students with extra time, they’ve always told me and I always ask them, I say, “are you okay with this?” And they’re like, “Yeah, it’s fine to have the normal time because I’m in a group.” So just some things to be aware of, if you’re going to try them out. And again, I could go on and on with these, so if anyone wants to learn more, hit me up. I’m happy to chat with ya.

Rebecca: Sounds like a good day to visit a classroom, huh?

Justin: It’s an energetic day for sure. Although you might not see much teaching going on if it’s just the assessment part. But it’s fun to drop in and see what’s happening.

John: There is a lot of teaching going on in their second stage, though.

Justin: Absolutely.

John: In fact, when I first did it, I was so excited about it, I made a short video recording and sent it to Rebecca, so she could see the dynamics of that interaction.

Rebecca: And hear it.

John: It was just really, really different than going over a quiz, where some of them would be really happy, but not that focused. And the students who did poorly were generally pretty disengaged when we went over a quiz ift they didn’t do so well. But when they were explaining it to each other, it was so much more positive.

Justin: Yeah. And you’re right, the teaching is happening. It’s coming from the students to each other. Not for me necessarily, but it’s coming from them. And it’s so powerful to see… absolutely to hear that live.

Rebecca: But you’ve set up the structure to facilitate it. So therefore, you’ve done the teaching.

Justin: [LAUGHTER] Thank you. Yeah.

Rebecca: So we always wrap up by asking: “what’s next?”

Justin: Yeah. So for me, what’s next? You mentioned at the top, John, I have this new position, I’m Associate Dean of Undergraduate Studies. And I mentioned in passing, I have a side business I called Recombinant Education. I do workshops for faculty. I’m writing a book. For me, I don’t know what happened, but last year, I had a birthday the ends in zero. Things have been a little wonky in my brain lately. And I listened to Taylor Swift now, sometimes. I never used to, but I think a lot of people do that. So it’s not just me turning that age. But the point being is that I’ve been doing this enough time now that I feel like I have things to share. And I’m trying to do more of that. So I’m trying to, and I’m still nervous to do things like this kind of stick my neck out and even talk to folks like yourselves, but I want to share best practices with teaching and learning, specifically with STEM education, because I still hear from students and I still see it from time to time, students are just not getting the best classroom experience they should be getting. College keeps getting more and more expensive. Students don’t deserve to have less than excellent experiences, in my opinion. I’m doing what I can on my own to share these best practices. Someone called me a one man teaching and learning center, it’s probably a fair way to say it. One of my students said, “Oh, you’re teaching teachers how to teach,” and that’s, I guess, another fair way to say it. But again, I got the energy for it now. I kinda have this midlife crisis going on too where I want to make some bigger impacts on the world outside of my own bubble, whether it’s at the administrative level at Mines now or across the country, or even the world. So I love working with other faculty on all these different areas. And that’s what I’m trying to make a big part of my day-to-day life now. But I’m still in the trenches. I’m still teaching classes every semester, because that really keeps me rooted, lets me try some new things out, still doing the DBER work and the SOTL work, working with students and just trying to have a blast and do what I can here in the time I have left.

John: Well, thank you for joining us. And we’re really looking forward to that book. And I hope you’ll come back and talk to us again when the book is close to coming out. Or sooner.

Justin: I would be honored to come back anytime John and Rebecca and if both of you are ever in the Denver golden area, please let me know. I’d be happy to show you around out here.

Rebecca: Well, thank you so much for joining us. It was fun to talk to you and to hear about the fun happening in your class.

John: More F words.

Rebecca: Yeah, [LAUGHTER] a lot of F words.

Justin: Yes. [LAUGHTER] Thank you both. I appreciate it. It was fun.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

GANESH: Editing assistance by Ganesh.

[MUSIC]

332. Challenges and Opportunities

Faculty and administrators have been faced with new challenges and opportunities as higher education adapts to a rapidly changing environment. In this episode, SUNY Chancellor John B. King Jr. joins us to discuss strategies that colleges and universities can adopt to navigate a successful path forward.

After graduating from Harvard, Dr. King acquired a Master’s degree from Teacher’s College, Columbia University, and taught high school social studies. He later co-founded Roxbury Preparatory Charter School and served as a co-Director for five years. Under his leadership, students in this school attained the highest scores of any urban middle school in the state and closed the racial achievement gap. After acquiring his doctoral degree from Columbia and a law degree from Yale, he served as New York State’s Education Commissioner from 2011 to 2014. Dr. King left NY for a while to work in the Obama administration as Deputy Secretary of Education from 2015 to 2016 and joined Obama’s Cabinet as Secretary of Education from 2015 to 2016. Following his work in the Obama Administration, Dr. King continued to advocate for increased educational equity and access as President and CEO of the Education Trust.

Transcript

John: Faculty and administrators have been faced with new challenges and opportunities as higher education adapts to a rapidly changing environment. In this episode, we discuss strategies that colleges and universities can adopt to navigate a successful path forward.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is the State University of New York Chancellor John B. King Jr. He has a long history of involvement with education. After graduating from Harvard, Dr. King acquired a Master’s degree from Teacher’s College, Columbia University, and taught high school social studies. He later co-founded Roxbury Preparatory Charter School and served as a co-Director for five years. Under his leadership, students in this school attained the highest scores of any urban middle school in the state and closed the racial achievement gap. After acquiring his doctoral degree from Columbia and a law degree from Yale, he served as New York State’s Education Commissioner from 2011 to 2014. Dr. King left NY for a while to work in the Obama administration as Deputy Secretary of Education from 2015 to 2016 and joined Obama’s Cabinet as Secretary of Education from 2015 to 2016. Following his work in the Obama Administration, Dr. King continued to advocate for increased educational equity and access as President and CEO of the Education Trust. Welcome, Chancellor King.

Chancellor King: Thanks so much, excited to talk with you all.

Rebecca: Today’s teas are: Chancellor King, are you drinking any tea with us today?

Chancellor King: I am, sweet ginger citrus tea. And this is part of my New Year’s resolution. I’ve always been a tea drinker, but I also am a longtime coffee drinker. [LAUGHTER] But a New Year’s resolution this year was to put the coffee aside and switch only to herbal no-caffeine tea. So that’s what I’m working on.

Rebecca: Well, I’m glad that you decided to record this podcast then as part of your New Year’s resolution.[LAUGHTER]

Chancellor King: It fits in perfectly. [LAUGHTER]

John: And following that theme. I am drinking a spearmint and peppermint blend tea, as another herbal tea.

Rebecca: I may have noted that I was trying to cut down on caffeine in an earlier podcast, but I happen to have a Scottish afternoon tea today. [LAUGHTER]

Chancellor King: No…

John: Which is a bit more caffeine than breakfast teas.

Rebecca: Yeah, my accountability isn’t working well. [LAUGHTER]

John: There’s so many things we’d like to discuss with you. But given the time limitations of the podcast, we’d like to focus on your views of the challenges and opportunities facing higher education today. What do you see as the major opportunities in higher ed today?

Chancellor King: I think higher ed is foundational to the long-term success of both our economy and our democracy. We have vital roles to play in both. Certainly, we have tremendous opportunities in the state to prepare students for success in the semiconductor industry which is rapidly growing in the state, for success in healthcare where we have tremendous needs, success in green jobs, and some of the resilience work that we’re going to need to do as a society because of climate change, tremendous opportunity to prepare students for every conceivable profession, from teachers to writers to actors to artists. And, we have a crucial role to play in the health of our democracy. We’ve got to make sure that we are preparing all of our students with a rich liberal arts education so that they can be critical thinkers, so they can be critical consumers of modern media, so that they can be discerning, so that they can make decisions as voters, as neighbors, as citizens. And we’ve got to make sure that our institutions are able to meet both of those missions across degree programs.

Rebecca: What are some of the ways that we can move forward on some of those opportunities?

Chancellor King: Well, look, we were very fortunate that last year, Governor Hochul and the legislature made such a significant investment in SUNY, $163 million, the largest operating aid increase SUNY has received in 20 plus years. It allowed us to make double digit percentage increases in state support at all of our state operated campuses as well as to invest funds in mental health services, services for students with disabilities, internships, which is critical to preparing students for those transitions to career. We were able to put $10 million towards the expansion of research, which is another critical role of the higher ed sector in the health of our society. And we’re able to dedicate consistent funds for supporting our food pantries across our institutions, because we worry about our students are struggling with food insecurity. So one way we move forward is through continuing to invest in the strength of our institutions. Another important way that we can move forward on that agenda is continuing to adapt our offerings, our programs, creating new paths for students, very excited about the Governor’s announcement around AI and the creation of Empire AI and what will be a significant investment in SUNY’s ability to prepare students for research and careers and ethical use of AI, very excited about the new Stony Brook Climate Resilience Campus, $700 million campus that will be built on Governors Island, just off the coast of Manhattan. So we’ve got to continue to evolve as we respond to the opportunities and challenges for our economy and for our democracy.

John: Speaking of challenges, what do you see as the major challenges facing higher ed today?

Chancellor King: There are, unfortunately, a number of major challenges. Many of our institutions, certainly at SUNY, but private institutions in the state, higher ed institutions across the country, have seen significant declines in enrollment. And that was all exacerbated by COVID. That said, I’m a glass half full, tea cup half full, kind of guy. [LAUGHTER] And I look at that and I say, part of what we need to do is evolve our thinking about who our students are. We’ve got to make sure that we’re reaching out to every New Yorker to let them know there’s a place at SUNY. We’ve got to do more work to make sure that we are recruiting low-income students, first-gen students, Black and Latino students, indigenous students, immigrant students, that more of our veterans know that they can come back after their service and find opportunity on our campuses, that folks who are involved in AmeriCorps service programs know that there’s a place for them at SUNY, that our working adults know that they can come back to SUNY, whether it’s one of our community colleges or one of our four-year institutions, to complete a degree that maybe they started and didn’t finish. We’ve got 2 million New Yorkers with some credits, no degree, or maybe that they’re coming to a campus for a microcredential or a certificate, but we’re gonna then help them leverage that into a degree program over time. So there’s the challenge of declining enrollment, but there’s also the opportunity. We are already seeing progress at SUNY, this is the first year in 10 years that we had an enrollment increase across all sectors. But another major challenge is the attacks that we’re seeing on academic freedom, on teaching the truth about our history, the attacks trying to undermine our ability to talk about the hard parts of our history, the times we fallen short of the promise of American democracy, slavery, the horrific treatment of Native Americans in the way land was taken from them. That’s a part of our history. It’s just the truth, and we’ve got to grapple with those hard truths. But there are folks all over the country, unfortunately, who are trying to prevent discussion of those topics, even states where they’re saying they don’t want any higher end institution to mention the word diversity or the word equity. So that I think is very dangerous, and very proud that in New York, we are standing up for those values. We’re gonna be the opposite of Florida, and we’re gonna stand up for diversity, equity, and inclusion, but I worry a lot about that attack.

John: One of the concerns that many people have are these attacks on higher ed, that are convincing more parents and many students that college is no longer needed. Because, for political reasons, perhaps, a lot of people are arguing that a college degree is no longer useful. What can we do to help push back against some of those attacks that we’re seeing nationwide?

Chancellor King: Yeah, you know, there are a few things. And certainly, we have to make the value proposition clear. It’s important that students understand and families understand that over your lifetime, if you have a bachelor’s degree, it will translate into a million dollars more of earnings. So there is this very clear value proposition. We’ve got to take on the affordability question, which a lot of families worry about. You hear so much about the student debt crisis. So we’ve got to really help folks understand how affordable SUNY is. 53% of our students across our institutions go tuition free because of the Pell program and the New York state tuition assistance program as well as the Excelsior program. And our tuition, as you know, just over $7,000, is significantly less than many of our peer institutions in neighboring states. It really is possible to get an incredibly high quality education affordably at SUNY, and we have to make sure that parents and students understand that. We’ve also got to, I think, go back to first principles around what is the purpose and the vision of higher education. The fact of the matter is, you look at almost every indicator, life expectancy, health outcomes, you name it, they’re better for folks who have higher education. And what we’re aspiring to, is to say come to our institutions for an education that will help you lead a healthier, more fulfilling life. I want you to come to our institution and maybe take art history, and so your life is enriched because when you travel, when you go to a new city, you go to a museum and you discover insights around art that you otherwise wouldn’t have had. That’s the part of the beauty of higher education. So we’ve got to make the value proposition argument, the dollars and cents argument, but I don’t want us to forget about also making the richness quality of education argument as well.

Rebecca: As we think about broader access, and our student bodies becoming increasingly diverse in a variety of ways, we do see a number of historically minoritized students having lower retention and DFW rates. What can educational institutions do to reduce some of these equity gaps in degree attainment and not just starting?

Chancellor King: So important, and at the Education Trust, this was really a major area of focus for us, trying to make the case that institutions have a responsibility to not only recruit first-year students, but to provide the supports necessary for students to complete and go on to success after graduation. One of the things we’re working on at SUNY, as I think you know, because Oswego’s very much part of this, we are replicating across 25 of our campuses a program called ASAP for community colleges or ACE for our four-year institutions. And the idea behind ASAP and ACE which has been shown to be successful in doubling completion rates in randomized controlled trials, so it has a tremendous evidence base. The core strategy around ASAP and ACE is to provide supports that make it more possible for students to be successful: more intensive advising, cohort experience, help with just-in-,time financial assistance for the student who, the car breaks down and so then they can’t get to their job, they can’t get to class and for want of $250 for the auto mechanic, they end up dropping out of school. ASAP and ACE have shown that if you provide that just-in-time financial support, it can make all the difference. There’s also an effort to support transportation, so that you try to take that out of the way as an obstacle for students. And I’m very hopeful about the impact that ASAP and ACE can have across our 25 campuses. But, more broadly, there’s really a cultural commitment we have to make as a community of institutions, that we are going to be laser focused on helping our students complete with a meaningful degree or credential. And so when we see those high DFW rates in a class, we’ve got to ask, “Well, is there more we could do in terms of academic intervention? Is there more support that we can provide? Are we seeing patterns for students with disabilities where they’re not getting the accommodations they need? Are there opportunities to maybe have those classes structured differently, so that students are able to get some of the foundational support they need at the same time as they are tackling new rigorous challenges, what sometimes people will refer to as co-requisite classes that integrate the remedial work with actual credit-earning college-level work.” So we’ve got to just be disciplined about this. And we’ve got to invest in the programs that we know will make a difference. EOP has been fabulously successful in New York for decades. Again, a set of wraparound supports, a sense of community for students, and importantly, financial assistance.

John: Are there any specific types of interventions in the classroom that seem to be particularly effective in terms of reducing some of the equity gaps by race, by first-gen status, and by Pell eligibility.

Chancellor King: It certainly varies by discipline, but a couple observations, one is relationship building is critically important. Students need to know that you care, and they need to know that they can come for help. When I was teaching at University of Maryland College Park before I came to SUNY, one of the things I would do every year on my syllabus, I would include basically a basic needs statement to say, here’s where you can go on campus if you are struggling with food insecurity, or housing insecurity, or if you need additional academic support, or you need additional mental health support. And here’s my contact information and my TAs contact information, and I want you to reach out if you need help in these areas outside of our class. Of course reach out if you need help with the work in our class, but if you need help in these other areas, please let us know. And just that step of communicating to students, here’s where the resources are and I want you to reach out for help, can be quite powerful. So relationships are critical. A second one I would point out is, again, it varies by discipline, but opportunities for students to do projects, hands-on learning, we’ve seen oftentimes that when classes are only lectures and exams, that students may not get as engaged. And it may not be as accessible to students as it could be. It takes more time. It’s more complicated to design courses that build in project-based or experiential learning. But we certainly need to be thoughtful about that, as we design courses.

Rebecca: I love the examples that you’re sharing because they really underscore that sense of belonging a student might gain and really feel seen, acknowledging that, you know, students may be housing insecure means you belong here, we know that you might be housing insecure.

Chancellor King: That’s right. That’s exactly right.

John: One of the things that’s had a pretty profound impact on higher ed, or at least it’s raised a lot of questions in higher ed, is the rapid development of AI tools ever since the introduction of ChatGPT last year. And we’re seeing new tools coming out almost every week or modifications on the existing tools. How do you see this affecting how we teach students and how students learn? And how can we prepare students better for a world in which they’ll be working with AI tools that’ll be increasingly better developed.

Chancellor King: It’s a fascinating set of questions. And this, I think, is going to be an important area of discussion for faculties across all of our SUNY institutions for many years to come. I’m very excited that the governor committed to the Empire AI initiative, because that will invest real resources in our institutions to do some of the research to unlock the potential power of AI to advance the public good. You think about some of the opportunities where AI could help with medical diagnosis and the development of treatment plans in medicine… early days, but we see some opportunities there. We’ve got an NSF grant at UB, University at Buffalo, to focus on the use of AI as a tool for improving instruction for students with disabilities, and there’s tremendous potential there. We know that AI can be leveraged for advances in manufacturing and robotics, so tremendous opportunities to leverage AI. There are also tremendous risks. We have a set of scholars at UB as well, who are working on the issue of deep fakes, and the risks that deep fakes pose to our democracy and the good functioning of our society. We have a faculty member at UAlbany, who is a philosophy professor whose focus through the early part of his career was on trust between people, and now he is writing about and studying trust between people and machines, as we think about how AI is reshaping elements of our society. So lots of opportunity here for us on the research side, and also some very real implications for thinking about teaching and learning. Some hopeful things like how can AI be used to power personalized tutoring for students who may be struggling? How can AI be used to create adaptive learning experiences where the level of challenges match to how students are responding to questions, but also, I think, a very real fear. Will students be doing their own work? Or will they be using chatGPT to write their paper? And so it’s going to challenge us to think differently about the kinds of assignments we give and where students take those assignments. So lots of questions that I think all of our faculty have to begin to think about, but we can’t pretend it’s not happening, that it’s not changing how students approach their work. And so we’ve got to be responsive.

John: I’m going to put in a plug for an event that SUNY will be sponsoring. There’s going to be an AI symposium taking place in Buffalo on May 21st. We’re working on a schedule for that, and we will include a link to any information about that in the show notes for anyone who might be interested in joining a discussion with many people from around SUNY about the implications of AI.

Chancellor King: There’s so much excitement around this. We had an AI task force this past semester that is now ongoing, and we had probably 80 faculty members across SUNY institutions participating in that and that was thinking about lots of different questions about the implications of AI. But I think this is a great chance for us to deepen collaboration across the SUNY system.

Rebecca: You really highlighted a wide range of both opportunities and challenges that institutions face as a whole. How do faculty see themselves in moving forward in facing some of the challenges in helping students achieve meaningful credentials or really meet meeting some of the demands of our very near future.

Chancellor King: The faculty are the heart and soul of SUNY. I visited all 64 campuses, as I mentioned, last year. I’m about halfway through visiting them all again. And I’m just continually inspired by the work I see happening across our campuses, just faculty members who are inspiring students, who are equipping students with critical skills that will help them in their professions and in their lives. So I’m very grateful for that. A couple of places where I think there are some real leadership opportunities, one is for faculty to play a role in supporting our recruitment efforts to make sure that when students of color, low-income students, first-gen students, are coming to campus, they are hearing a clear message from faculty that they are wanted. One of the worries I have about the Supreme Court decision last year ending race-conscious admissions, is that it sent a message to black, Latino, Indigenous students, you are not welcome in higher education. And we want to send the opposite message, we want to say there’s a place for every New Yorker at SUNY. Our classrooms are stronger when our student body is diverse; our faculties are stronger when they’re diverse; our research is better when diverse researchers are engaged in solving problems together. So recruitment is one opportunity. Second opportunity, I think, is to continually ask how do we evolve our instruction and our course content to align with our evolving students in our evolving society? Now, we’re always going to want students to engage with the great conversation about what is the good life, we’re always gonna read Plato and Aristotle. But at the same time, we got to think about how are the questions we’re asking maybe different given what our students face today. So I think about when I was at one of our campuses, speaking with a botany professor, who was saying that he’d really never had full enrollment in his course, he always had empty seats. But this past year, he was teaching a course in the horticulture of cannabis and waitlists. And it wasn’t to say that every student in that class is going to get a job in the cannabis industry, though certainly the cannabis industry is going to grow in New York. But that course will be a gateway to getting excited about agriculture and an interest in careers in agriculture, which are plentiful as a whole generation of folks in the agriculture industry retire. We have lots of need for folks with expertise in agriculture, sustainable agriculture, in particular. So maybe being in that course on the horticulture of cannabis will bring them into this new field. So it’s not that he’s teaching something entirely different, it’s kind of tapping into the intersection of his discipline and what students are curious about. Similarly, you think about health care, and the challenges we have in the healthcare sector, students are really interested in learning about racial health disparities, and understanding how we’re going to tackle those. And I’m not saying diverse students are interested in those questions, because they see the horrific maternal health disparities by race that we have, and they want to make it better. So we should talk about that in our nursing classes, in our public health classes, in our medical schools. So this evolution of our teaching and our content to meet the moment, I think, is hugely important. And then I would add, we are stronger together. And so collaboration across disciplines, collaboration across institutions, strengthening transfer pathways, for example. 80% of the students who start community college, say they want to earn a bachelor’s degree, but less than 20%, do. We can do better, we have to do better. And so those partnerships, not only institutional partnerships, so that credits transfer and those things, but also faculty collaboration. What do we advise students about which courses to take if they’re interested in a particular degree when they come to the four-year institution? How do we improve advising at the two-year institution? Those kinds of things are an important place where faculty can engage.

John: As you mentioned, SUNY has done quite a bit of work in easing transfer credit across institutions, between community colleges and four-year colleges. But we have those really poor success rates for students who plan to go on for a bachelor’s. Are there any other strategies that could be used to help ease that transition from community college into four-year programs?

Chancellor King: Absolutely. You know, we have a transfer task force with folks from across our two- and four-year institutions working on this set of questions. Some of the things that we’re seeing that are promising around the country: advising… crucial, particularly as you’re picking classes, as you’re thinking about your major and how it will translate into what you want to ultimately do in your career, improving advising at the community college level, particularly if, and we have some folks who are using transformation funds, some of the funding we got last year from Governor Hochul and the legislature to do this, particularly if you can get the four-year institution to either place their staff as the advisors on a two-year campus, or to work in very close partnership with the advisors on the two-year campus to help ease that navigation. Another issue is what I might describe as friction reduction. One of the things we started this past year, which we will continue to grow is a SUNY match process where we reach out directly to students in our two-year programs and saying, “You are directly admitted to these four-year institutions based on your academic record at the two-year institution,” because for a lot of students, especially first-gen students, it’s that feeling of “Well, college, it it really for me, is a four-year institution really for me, am I ready for a four-year institution.” But it can be transformative to get that letter, that personalized letter that says there is a place for you at the four-year institution. And then look, there’s lowering financial barriers. That’s critical. One of the things I’m excited about that the governor announced in her State of the State and included in her budget is Universal FAFSA, making sure that students complete the Free Application for Federal Student Aid, because that’s how they know what resources are available to them. And some of our community college students, unfortunately, they don’t realize the aid they could have and so they’re struggling to afford the two-year institution and making the choice not to pursue a four-year degree because they don’t know the Pell dollars, the TAP dollars that could be there for them. That’s why we need them to do the FAFSA. Last year in New York, students left $200 million in federal aid unclaimed because of not completing the FAFSA. And so Governor Hochul wants to require K-12 to work with us in higher ed, to make sure that every student either completes the FAFSA, completes the DREAM Act application if they’re undocumented, or they and their family would complete a waiver that says “I realize there are billions of dollars available for post-secondary education, and I don’t want any. I’m not gonna fill out the form.” But at least we’ll know that every student and family understood the options available to them.

Rebecca: Sounds like some really great opportunities. I’m watching our time and knowing that we’re nearing our end of our time. But I’m really curious, before we get to our last question, what you’re most excited about working on in the next year?

Chancellor King: I love that question. I’ll tell you one of the things that I’m very passionate about. I first worked on when I was at the U.S. Education Department, President Obama had an initiative called My Brother’s Keeper, which was about trying to improve outcomes for boys and young men of color. And as part of that initiative, I was very involved in kind of leading the agency work on that initiative when I was Deputy Secretary then continued that as Secretary. And one of the initiatives that we launched was something called Second Chance Pell. And the history there is that in 94 in the crime bill, there are many problematic provisions, but one that was especially dumb was a provision that banned access to Pell grants for folks who are incarcerated. Now, of course, the evidence is any educational experience while incarcerated reduces the likelihood of recidivism. And completing a degree while incarcerated dramatically reduces the likelihood of returning to prison. So shamefully, this was part of the tough on crime punishment first kind of focus of the mid 90s. They banned access to Pell Grants, as a result programs in prisons all over the country closed. Some remained open through philanthropy, but many many closed. We wanted to change that, and so we used our experimental authority under the Higher Education Act to create a pilot program called Second Chance Pell that would allow, at that time, 65 colleges and universities to use Pell grants with students who are incarcerated. We launched that while I was Secretary. And then, when I was at Ed Trust, a coalition of civil rights groups, criminal justice reform organizations, education equity focused organizations worked together to get folks to visit those programs, members of Congress, Governors to highlight the incredible stories of the students who graduated from higher ed in prison programs. And we were able to persuade Congress to change the law and restore Pell access generally. So today, Pell Grants are available for incarcerated students. SUNY is already the largest provider of higher education in the state’s prisons with over 700 students, but we are trying to grow that effort. I want there to be a higher education program in every correctional facility in New York State. I want to make sure that we grow the number of bachelor’s programs. We have a lot of associate’s degree programs, but I want to make sure that students have the opportunity to go on to their bachelor’s degree. I was at graduation last week, mid-State Correctional Facility, five students graduating from Herkimer Community College. It was so beautiful and inspiring to see the transformative power of education, to hear students talk about how the access to higher education had changed them, changed their lives, changed their prospects for when they come home, but changed them as people. The faculty members were crying, the family members were crying, the folks in the correctional facility were so excited for the students who were graduating. It was truly, truly inspiring. So I’m very excited about that work. I’m looking forward to growing that work. But then more broadly, I’m excited that SUNY is on the move. SUNY is delivering high quality, affordable public higher education, driving economic opportunity for New York State. We are working to improve recruitment, retention, and completion. We are advancing diversity, equity, and inclusion. We are doing the things that we ought to be to better serve New Yorkers. So I’m super excited about our work together.

John: Those are really important programs. And we’re so glad to hear all of this. We always end with the question: “What’s next?” I know you’ve already addressed a lot of this, but there’s so much more.

Chancellor King: Well, you know, we try to organize our work around the aspiration that SUNY has to be the best public statewide system of higher education in the United States. And we’re the largest comprehensive system, but it’s very important that we work to be the best system. To me that means we’ve got to deliver on student success. We’ve got to deliver on research and scholarship, the Governor’s asked us to double research and scholarship across the system. We’ve got to deliver on diversity, equity, and inclusion, that means diversity of our students, our faculty, our leadership, across our institutions. It means implementing the diversity, equity and inclusion, general education requirement, which is really nation leading to say every student is going to be exposed to diversity, equity, inclusion content across all of our institutions. And we’ve got to deliver on economic development and upward mobility, which has been the SUNY tradition for 75 years. So I organize how I think about the work. And certainly our board is organizing its work around those four pillars in order to achieve that goal of being the best statewide public higher education system. In the short term, we got a state budget that hopefully will be enacted on April1. So we got a lot of work to do to make sure we are making the case for investment in SUNY and helping people to see there’s a nine to one return on each state dollar invested in SUNY in terms of the economic impact. We need legislators to know that and we need to work with them to make sure that they are investing in the great work that our faculty are doing.

Rebecca: Well thank you so much for your insight on the current state of higher ed and all the opportunities that we have to improve our society.

Chancellor King: Thank you. Thanks for the opportunity to join you and thanks for fostering dialogue on important issues.

John: And thank you for giving up your time so generously and all the work that you’ve done and are continuing to do.

Chancellor King: Thanks so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

331. Not Your Mother’s Dorm Room

Recent trends in dormitory construction have provided students with more private space and less shared space. In this episode, Shelagh McCartney joins us to examine the reasons for this trend and discuss the effect these changes have on student persistence and success.

Shelagh is a licensed architect and urbanist and an Associate Professor and Director of the Together Design Lab at the School of Urban and Regional Planning at Toronto Metropolitan University.  She is the co-author with Ximena Rosenvasser of “Not Your Parents’ Dorm Room: Changes in Universities’ Residential Housing Privacy Levels and Impacts on Student Success.”

Show Notes

Transcript

John: Recent trends in dormitory construction have provided students with more private space and less shared space. In this episode, we examine the reasons for this trend and discuss the effect these changes have on student persistence and success.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Shelagh McCartney. Shelagh is a licensed architect and urbanist and an Associate Professor and Director of the Together Design Lab at the School of Urban and Regional Planning at Toronto Metropolitan University. She is the co-author with Ximena Rosenvasser of “Not Your Parents’ Dorm Room: Changes in Universities’ Residential Housing Privacy Levels and Impacts on Student Success.” Welcome, Shelagh.

Shelagh: Thanks so much. I’m really happy to be here.

Rebecca: Today’s teas are:… Shelagh, are you drinking tea with us today?

Shelagh: I am drinking tea with you today.

Rebecca: Any special kind?

Shelagh: Earl Grey tea.

Rebecca: That’s a good classic.

John: It is. I am drinking Darjeeling today.

Shelagh: Very nice.

Rebecca: And I have a Scottish afternoon tea.

John: We’re recording in the afternoon. So that works well.

Shelagh: Perfect.

Rebecca: Just barely. [LAUGHTER]

John: We’ve invited you here today to discuss your article on changes in universities’ residential housing and some of the other work you’ve been doing. Before we discuss the study, it might be helpful to discuss how architectural design helps to shape human interactions.

Shelagh: Well, I think when we think about how design in general really shapes who we meet, when we meet, how people interact together, and whether it’s a comfortable interaction or something that happens more often. And I guess in the context of university housing, it begins to be about socialization, friendship, likelihood of creating friendship, and then how that actually translates into academic success, because people that are able to build those broader networks tend to do better in university because they have a better network and resource groups to go to during the ups and downs of university. Intuitively, we sort of associate place where you live with our mood, our familiar bonding, or a refuge for the world, or when we invite over people to share that space with us. And in our researches, we really looked at people such as Altman in the 1970s, who presented theories on how people were experiencing the lived environment. He discussed privacy, socialization, and how people would manage their environment to either connect with others or isolate themselves from others. And to do so, people resort to what he referred to as environmental mechanisms or behavioral mechanisms. So an environmental mechanism would be to close the door, And a behavioral mechanism would be someone to ask to leave the room like to say to someone, “Can you please leave me alone, I need to go and do my studying that I need to do.” And so some of the other research when we think also of linking these pieces together, and with architecture, it’s complicated, because we’re looking at other disciplines. And so when we think about Altman, and then we reach deeper into psychology of lived spaces with can think of Festinger, Schacter, and Back in the 1950s, unplanned meetings or chance encounters that discussed the influence that the built environment has the ability to sort of facilitate social interactions, friendships to come together, and more times we meet with people of similar interests, the higher chances are that we’re going to have a better connection with them, or friendships to arise. And of course, the strong interpersonal connections also affect our well being. So for students that’s reflected in how well they perform academically and their satisfaction with the university as a whole in terms of our experience. So these works I’ve really talked a lot about, the 1950s, the 1970s, and that’s really where a lot of this work came from. And I will say that we became concerned when we began to see sort of a shifting trend of what we were hearing in the types of lived environments, and that historically, university residence has been linked to having stronger academic outputs. But if the built environment begins to change, then maybe that wouldn’t be the same. And so that was sort of a rise from concern about five years ago. And then thinking about how we could actually look at a study and build a study around this to look at the changes we were seeing. And so in our initial work, we discussed student life and how we were studying university. So in my case, my first experience at university was living with a roommate in a shared bedroom, and sharing a common space such as a bathroom and a lounge. I like to joke that I could have held hands while lying in bed with my roommate, our beds were that close together. [LAUGHTER] And we had common dining with the whole building, but activities such as meeting in the hallways, or leaving the door open for people to come in and be able to hang out and remembering the sort of feelings also associated with that, to create friendships and networks. But students today have a completely different university experience. They’re offered a wide type of living units, apartments, larger super suites. So we’ve sort of set to investigate how these new living units are affecting students.

Rebecca: You’ve hinted at some of the changes that have occurred more recently. Can you talk about some of the changes that have happened over the last couple of decades and maybe why some of that change has actually occurred?

Shelagh: So when we think about the changes that have happened the last 20 or 30 years, I think it’s really important that there is a sort of inflection point, that after World War II student housing completely change with the rising rapid enrollment, especially by military veterans, and encouraged by sort of the state to receive university education and to be able to begin their lives after the war. And so we really see the rise at that point in time to change the kind of living environment. So the role of universities in providing housing for students also shifted. And we see that shift post-World War II. And then we are beginning to see that shift in the 1990s as well. So at that time, when we think about what was happening after World War Two, it was decided that universities and government would take that role of building fast, high-density residences with common dining spaces, in our case across Canada, but it did happen the U.S. as well, to meet that demand for student housing. And the design of these dormitories were called barrack buildings, which when we think about post-World War II, that begins to make sense, due to the similarity with military barracks. At that time, it was considered that veterans would not complain about simple features and amenities of these accommodations. And it was a successful experience, housing the majority of the student population on campus housing. And this is today what we think of as being what we call traditional residences, this sort of shared bathrooms, common dining room experience, many times single, double, triple, or quad rooms, and how many people that they were actually housing within those spaces. So that’s what we think of when we’re thinking about the traditional mothers’ dorm room. Then the other inflection point that I spoke about was in the 1990s, that this custodial role that universities had for university housing was really put to the test. Universities were systematically defunded, with their financing mainly coming from enrollment numbers. And at this time, government funding for infrastructure decreased considerably. This is why we’re seeing higher incomes of international student enrollments as well as universities using the unregulated tuition fees of international students to finance themselves. I’m speaking from the Canadian context, most of our universities in Canada… I’m saying most, but I want to say all… are public institutions, so we don’t have this similar division. So a lot of the funding comes through universities from the governments themselves. And this funding model had a radical shift on what happened in terms of thinking about the housing. So consequently, enrollment numbers continued to grow, but there wasn’t the facilities necessarily to put into place. And so what we’re seeing now is that private developers are associated with universities began building on campus residence to meet this demand. And so later on, especially in the last 10 years, we’re really seeing that the private developers are taking the lead in building student housing mostly in off-campus developments. And the new units are no longer responding to universities’ housing models, but they would try to cater to what I’m going to say is like students’ preferences. And I want to be clear that these are student preferences and parent preferences prior to the student entering university, I think there’s a significant discussion around what are students’ actual preferences, and what are the perceived preferences before they come in. So what we’re seeing how the new units are being structured, they’re allocating more facilities into private spaces, they’re starting to provide more private bedrooms, but also private bathrooms, also private lounges, also private kitchens, and private developers would also build multiple apartments. So in the last 10 years, private developers in some association with universities are building mostly single and double apartments, which means it’s sort of almost like a… we would say, in Toronto… a mini condo, but that would be a single bedroom, with a lounge, a kitchen, a bathroom, all within your own unit. Some of them are multiple apartments, would be separate bedrooms with those other shared facilities. And then also beginning to think about that they could be building single and double suites. What that is, it’s a private or semi-private bedroom, lounge and bathroom, but more of a communal kitchen that’s outside of the unit. And so in Toronto, in the last 10 years, there have not been any more traditional units built or our parents’ dorm rooms built at all. And so when we think about that shift of what’s been associated with a on-campus experience, that that’s not occurring. So although the total number of these high-privacy units in Toronto right now is small and doesn’t represent a majority of where students live, they are representing what is being constructed today, and what is on most of the horizon moving forward. And that’s really why we were concerned and that we are trying to put the research behind that to say, to think about the student experience and how to advise consulting firms and to encourage universities to actually think of the housing experience as part of the university experience, not as something that they put to the side that someone else handles. This isn’t just heads and beds. This is part of the university experience. And also it is directly tied into how people feel about their university experience as in would they recommend someone going to that university is based primarily a lot on their housing experience.

John: Why has there been this shift in the perceived preferences of students? Is it due to rising incomes, so that it’s easier for students and their families to afford more expensive housing because the barracks-style housing would be relatively less expensive than the private suites and so forth? Or might it be partly due to perhaps a decline in fertility rates so that family sizes are smaller and students coming into our colleges are less likely to have had prior experience sharing a room with a sibling, for example.

Shelagh: I can’t speak directly to fertility rates and how the relationship of that does come together. I wouldn’t say that fertility rates have declined so much lately that there has been a changed experience. When we look at occupancy, the occupancy of the average people per household has remained relatively the same in the last 20 or 30 years. But I would say probably in the 60s and 70s, it could have been different, at least here. We’ve had a large immigrant population that’s come to Canada in the 60s, 70s, and 80s. It continues today, and a lot of people want the best for their kids. They’d worked hard to secure a future to have the best for their children. And most of these more luxury places cost more. So this is the cost for this traditional room, and this is the cost for this other one that is more expensive to build, more expensive to run. And so there is a notion of attaching the luxury piece to it. So when we think of society as this trend, particularly in Western cultures, there is a tendency towards larger private spaces. When we think of the size of homes, of how they’ve grown as compared to post-World War II student housing, we begin to think about the two major trends that started in the 1990s in student housing, was first the involvement of private developers that imitate rental types of other units, and cater them to students, such as single units or apartments shared with only one or two people. And in the sense that developers are building something that they can easily redirect to another public if needed. I think that this is actually quite an important piece, is the financing behind it. And the flexibility of a developer that is not a university, and may actually want to pivot if the student housing market isn’t the new asset class that people are relying on so much in terms of having their returns, and could pivot actually to rent it within the normal housing market. It’d be more difficult to do that with a traditional or barracks style room. And so the second is also the commodification of the student experience and emphasis on student preferences. So there’s a lack of research for a long time on student housing that actively involved universities and developers to seek students’ wellbeing. It was more thinking about “what is the preferences,” it was very much driven by parents entering university, children entering university rather than actually students there. So in one of our subsequent studies, we actually took students and said, “Okay, these are the options, these are your preferences, and we gave them all the money in the world.” And so we did like a mock game on this and then we constrained them, and what amount of money they had to spend, and we were able to actually prioritize themn And so to me, that’s a contribution that we’ve made, because there’s one thing to say, what would you like. I’d like a pony. I’d like a unicorn, I’d love a great car, maybe a different type of house, but I may not be thinking about how I’m going to pay for that. What are my actual priorities? So by constraining the students, we push the dial a little bit to say, “Okay, what do you want?” And one of the main things that came back was affordability, they may have a preference for all these things that people say what they want, but when they’re asked to actually balance it, people actually chose differently, quite differently based on what their preferences were. And these were existing students. And I also think, within the barracks style, is that we’re not advocating that everything be built traditional, because there is different personalities out there that succeed differently, and better in different types of housing. But we just want to make sure that the new kind of housing isn’t all that’s being constructed, and that people that may have felt crowded in the quadruple rooms on barracks style housing, and a lot of studies are that way, they compare quadruple rooms, traditional rooms, with single apartments. And there’s so much of a spectrum in between there that I think really comes out in our work. And we’ve tried to allow people to access that, to be able to compare the spectrum, the pieces in between within that. A lot of the research was comparing severely crowded ways of being that people couldn’t have any kind of privacy to something that was very, very, very, very, very private, and then therefore saying that this other thing was bad. And so when we think about this commodification that’s happened, that there is a lack of research of students being actively engaged within that. And that’s true that there is some expectations of recreating what is offered in the familial home. So Kaplan stated that if students are used to sharing a bedroom in their own homes, directly thinking what you mentioned, John, than there also be more comfortable at university doing that. And the cultural differences, I think, is also what applies. We’re beginning to see that and Heilweil identified it as well, that there’s some cultures and subcultures that are more comfortable and want to share their space and their belongings. Even if they have the money to be able to rent the more private unit, they actually prefer to live with someone in more close proximity to them. So when we think about how these changes have affected cost and affordability, this is what also really tips the scales to us when we think about the stress. It’s virtually inaccessible and unaffordable to live close by to universities for a majority of reasons. So nowadays in Toronto, about 70% of the students remain in the familial home, because universities don’t have enough residences, or people can’t afford to live within them because of the lack of affordable housing that’s available. And for developers, this is a perfect storm of having low vacancy and high prices close to universities, that encouraged them to focus it on these luxury products that they could flip into condos and don’t satisfy the needs of the majority of the student population as well. But we’re seeing a change in the discourse of talking to developers who are now showing interest in changing the strategies we’re putting forward thus far in the city itself. And I think that that’s one thing that’s quite interesting in the Toronto context is that the developers that are working here tend to be smaller, almost family-oriented developers. And so you’re literally talking to the person that’s making some of the main decisions, and that it is a family enterprise. And so in some of our grants moving forward, we have actually applied to do some of this work with developers to move the conversation along in this context, and then sharing it more broadly, because the Canadian population isn’t so dissimilar to the rest of the populations in North America as well. So although I can’t sort of speak to fertility rates, I think that we’ve seen a growth in the size of bedrooms since the 1940s, across the countries, across North America, and that is being emulated in the student homes, and the student residences that people are seeking.

Rebecca: You mentioned earlier a difference between perceived wants in housing prior to starting university, and then you implied that there might be a change once they’re here. Can you talk a little bit about that potential shift that happens.

Shelagh: So I think what we’ve seen is that there is a lot of desire to emulate the familial home, and not want to share anything. I don’t know anybody. I want to have my own bathroom. I want to have my own bedroom. I want to be able to cook. I want to have the most flexibility that I can. And what we’re actually seeing is that when we work with students that are actually students, and they’ve had some university experience already, that there’s more of a desire to share. They are putting more weight on the networks and the importance of the networks because people forget that they are sharing those things if they’re living within a family environment, there is another adult there that they’re sharing with, there may be other siblings that they’re sharing with. And so they’re getting those different interactions. And now when you take a student and put them in their own apartment by themselves, and there isn’t a need to go out, that they forget that they’re not actually seeing anybody in those chance encounters that are moving forward. And Ximena and I, in our latest piece of research with Yemi Adediji, we’ve looked at it really quantifiably. We have 11 years of research, 11 years of administrative documentation across all of the universities in Toronto. And we were able to actually classify them by room and being able to see how successful that they’re being. And in speaking to the students as well, we have another article that is published called Affordability is King. Affordability is King is that people really want to be able to have one space that’s private. And so we would probably, similar to as John said, that a barracks building is easier and cheaper to build. And we could actually drive this as affordability. We would be advocating for small individual rooms, that people could be able to have one space where they can feel private, and yet the rest of the spaces where they are going to be able to have different chance encounters. And interestingly, a lot of it hinges on the bathroom. And we think that that’s because one has to go to the bathroom more times than they eat. And also, if you’re in a shared space, brushing your teeth near somebody, that is a bit more of an intimate experience, and therefore you’re more likely to engage with each other in the dining room. Whereas we are seeing the research of bedrooms that have bathrooms within the unit, that their grades are substantially impacted negatively. I know that’s not in the current one. But the swings are substantial. They’re nine grade points out of 100.

John: That’s really interesting. I’m a little surprised by that, but that is one sort of shared space that everyone has to use. A lounge, for example, might not always be used, it could be empty much of the time, and in fact, in many dorms, they have been, but the bathrooms would get a lot of visitors often at the same times of the day.

Shelagh: So I think it’s also sort of this balance between those spaces that are designed for socialization and there’s places that are designed for privacy. But we speak a lot about balanced privacy. And one of the current pieces that we’re working on is: “what does that actually mean?” And using tools that we’ve developed to allow people to say, “Well, what is the privacy that I’m looking at within here? How can I begin to put that on a scale to understand how those are connected to each other?” And then again, with a large quantifiable study, it’s 28,000 students in that time period, so a substantial dataset to be working with. So some of the results have been surprising. And then to really begin to think about what that means for the design of spaces. If we were to give people advice as to what they should be investing in in terms of so social spaces. Designing a really great social bathroom could be one of them. And I reflected on my university experiences, sometimes the getting ready to go out was more fun than the actual going out.

John: One of the things you did was design an instrument called the hierarchy of isolation and privacy in architecture to help describe some of those changes. Could you describe what this index captures?

Shelagh: Well, it begins to look at the different spaces within the unit, and then to think about how many people you’re interacting with within that space. And so there’s a significant difference between single bedrooms, double bedrooms, and three and four bedrooms. And so we looked at each of the spaces and to say, really following Altman to think about primary and secondary territories. Are you by yourself? Are you sharing them with one person? Are you sharing them with a small group? And then to allow that to guide more of the discussions, again, because there is this real weights of the opposite ends of the spectrums, and we were trying to communicate that there’s much more nuance to this. And so we actually use the HIPAT tool in some of the new work that we’re just getting to journals now, to really look at all of the different units just to say, “Well, what does balanced privacy actually look like?” We gave a tool to actually be able to talk about it and measure it. And we were seeing in the literature, a lot of psychologists and people saying, “This is what we’re observing, but we don’t know how to analyze the built environment.” And so we’re hoping that it would be a tool that would allow many other disciplines to interact with architecture in a way that is more organized and they can begin to speak to each other around this tool. I think that that’s a common thing within our research together, we’re always looking for ways to bring the disciplines together, because so many people can speak about the built environment. But it’s a real shame that if you can have a great psychologist or sociologist that’s looking at a piece, and then just says, “Well, I can’t analyze the built space.” This is a tool to allow them to be able to engage in that.

John: And we should note that citations for all the studies that have been mentioned will be included in the show notes. And when they are publicly available, we’ll include a link to them as well, just so our listeners know that they can find more resources about this as a follow up.

Shelagh: Well, thank you. And I know that in the HIPAT tool that we also developed and built on the housing classification, again, many of the housing classifications are organized in how a developer thinks about constructing a space like “does the space have a kitchen?” “does the space have a bathroom?” and so they were comparing apartments to traditional but again, if there’s four people living in apartment that’s completely different if there’s one person living in an apartment, and so the HUC tool, or the housing unit classification system, was designed to tease that apart and we’re finding a lot of people in co-op housing, co-housing are beginning to talk to us or citations of using this as a more organized way to describe housing in other situations as well. So it’s not designed only for student housing, there’s many other ways that it can be used in terms of innovative people sharing space.

John: In general, in the design of academic buildings, at least on our campus and many campuses in the US, there’s been a shift to create more spaces for students to interact. But it sounds like the trend in dormitory housing, where students spend a fair amount of time, has been in the opposite direction. And there’s been a lot of research in the last few years about the importance of connections and networks and so forth in terms of student success and retention and wellbeing. How have these two things diverged in that way? Why has the architecture of dorms gone in a very different direction than architectural trends in the design of academic spaces.

Shelagh: Well, I think that, particularly in the States, the housing, through the provision of different amenities has been used as a way to attract students to the campus. The housing experience in Canadian universities is not radically different. And because we have a different donor funding structure, I think that that’s why we’re seeing a lot more of the amenities that are available in US residences, we’re really seeing that change in terms of attracting students, in terms of the amenities. And so I think we’re seeing the mirroring more pronounced, let’s put it that way, the mirroring of the familial home. And again, this notion of “I’ve worked so hard to get to this place, and I want to put my kids through the university.” I will say, our parents’ generation, or my parents’ generation, did not attend university the same kind of way. And that generation is shifting now. The people that are starting to send their kids to university went themselves, which when we think about that article that says “Not my Mother’s Dorm Room,“ my mother hadn’t gone to university. So they were doing what everyone else did. We were seeing through the 80s and the 90s is that generation pushing for the best for their kid. I’ve worked so hard, and I didn’t go to university, but I want the best for my kid going to university. And now what we’re beginning to see is people say affordability is more important. I went to university. I lived in that environment. There’s no way, kid, I’m paying for a luxury place for you to be. So we may actually begin to see a shift. But I do think that the REIT and development and financing structure has a very large impact on how the units come together. And so within that, if the developer can build a type of housing environment that could be flipped to be thought of as being single apartments, or double apartments, even, then the banks feel more comfortable lending money to them. And we don’t have as developed a REIT structure. And so they feel more comfortable lending to them. I’ve had developers say to me, I wanted to do that. But we’re talking about five point difference that I was getting offered rates of 2, 3%, as compared to 6, 7. That’s a drastic change in my financing model, I think in universities as well, that the custodial role of the different universities is changing. And again, a lot of the discussions have been give it away, University’s job is not actually to house students, to not to be the parent. But that was always the historical role, the custodial role of them. And so when we think about it, like coming back with the emulation of wanting to be in the parents home, combined with not necessarily enough understanding, for us, we began to be concerned. And when we looked at the literature, people hadn’t touched this topic as much since the 70s. More of it’s coming out now, and a lot of it was based on academic spaces, but within the housing, that it was really, again, looking at these two opposites. And so we wanted to develop more tools around that, and not based on our tools, but there is more interest in looking at this. And I think, as the universities begin to think about what is the financial situation that they’re in, how they will begin to progress on that, but residences, I know in the States, more than Canada, have been used as a vehicle to be able to attract students as sort of the having these great, amazing environments. I think if you said to a Canadian parent, like there’s a lazy river in the residence, people would think that that was not something that they would ever think would be there. Whereas I think the amenities that are available and some of the residences, that they’re pretty luxurious and pretty fun and that’s a huge attraction.

Rebecca: What are some of the consequences of not really paying attention to our residence hall development and not really thinking about these academic implications, or some of the social implications? What are the long term effects of some of these decisions?

Shelagh: We think ultimately, people will not have the same positive university experience, the benefits that you typically see out of living on campus won’t be there. Students become more dissatisfied with their university experience and don’t necessarily want to attend. And I think this is something we’re trying to outline in the literature that it starts to become also an equity discussion. Like he who has the money to be able to afford said residence and actually even be able to live in a university residence. Myself, Ximena with Kiana Basiri and Cynthia Holmes, we’ve recently completed a study that we’re putting in for publication, it is in the revise and resubmit piece right now. But it is looking at the implication of, again, GPA, we have about 750,000 students that we’re looking at and looking at them longitudinally. People that live in residence graduate more often, people that live in residence have a significantly higher GPA, on average, and then myself, Ximena and Yemi, we looked at well, when we break that down by unit type, what does that mean? I sort of alluded to the fact that it’s substantial between the differences. But the differences, as I said, between single apartments and this ideal single room on a traditional floor, where you’re sharing a bathroom, having a different dining experience, a 9-point difference is the difference between an A-minus and a B-minus. So the GPA will get lower, and you’ll sometimes see people that won’t be able to pursue university education. I do think one of the largest concern now is affordability. John, you stole my moment. But you advocated for the fact that it’s cheaper to build. We’re actually saying, build single rooms, sharing all of these amenities together, and pay attention to the fact that they are places where you have to go, that it isn’t just the lounge, thinking about the hallway spaces and the bathrooms, places that you need to go and where you will be interacting with people. So, i.e., these bathrooms are not single stalls with doors along a wall that you go into and experience completely separately, that there is a place where there is interaction. But the long-term effects is the fact in many of these areas, if you don’t build the right kind of residences, we’re literally seeing the ability for a poor student to succeed, that they will likely fail and will not continue in the university. But around the affordability question is that if universities aren’t paying attention to the curriculum of housing that you are going to create an inequity in the system. He who can pay to live close to the university is going to do significantly better than he who can’t. They’re then more likely to go into graduate studies as well. And they’re also probably going to only going to socialize with their own socio-economic group. And then you begin to see divisions on campus socially. And if areas of housing is not affordable, then when we think about the meritocracy that we sort of say hard work and brains, then you can succeed. We’re beginning to divide society. I mean, that’s the big doom and gloom piece, but it is one of the pieces sort of lit are concerns, just to say this is a a type of experience that leads to success. And if we’re not paying attention to the type of units that we’re building, there may be a lot of investment and we’re not going to get the results we think we’re going to get from them. And from that, some universities, if they don’t have housing available or don’t build great housing, or housing that really builds their campus, they may see people begin to not to want to go to university there. In Toronto, for instance, as with this unaffordable housing economy, you can begin to see the impacts on the success of the city, because you’re not attracting top minds. I have lots of people that reach out to me now saying, “Well, what would faculty housing look like?” Because we’re beginning to see land values go up typically by 1% by kilometer that you get closer to a university. So talking about affordable housing beside a university is kind of a paradox to that unless the university takes a role in that. So you begin to see his brain drain of talent away from the university, and thus away from a city.

John: Are there any other observations you’d like to share with our listeners?

Shelagh: When we’re thinking about these academic spaces, there’s a push generally towards more space. I would add that design is really important in these spaces. It’s not lost on me that the type of units that we are advocating for are the ones that are in the classic dormzilla Munger building on the west coast that has been very highlighted, let’s say, in discussions around university housing. But within that, it’s not just about the unit, the unit is important, but things like light are important. And it’s not just about lounge space, it’s about good lounge space, and really considering what are the interactions that people will have. And so new residences offer a wide range of social spaces that are not offered in traditional residences. And so in our studies, we investigate students’ daily activities, and if those activities correlate with a fixed space or not. So it’s not only a matter of students meeting informally, or in an unplanned way, but the familiarity with strangers that later become acquaintances, and hopefully friends, I think, is really important. And then our latest research, we found a very particular connection between dining spaces and GPA. And dining spaces, as they become more flexible in the terms of universities, allowing students as meals all across campus, we actually see a negative correlation because student interaction diminishes of meeting up with the same people, and so does GPA. And again, I was expecting smaller point percentages, you know, maybe the difference between a B and a B+. But again, within these, we’re seeing quite significant gaps within that. And so for us, it has led us to investigate more different pieces on top of it.

Rebecca: Well, we always wrap up by asking: “What’s next?”:

Shelagh: For student housing, within that I would say hopefully more and better. So which coincidently is more affordable for students, as well as what we are advocating for: single rooms with a lot of shared spaces are cheaper to build, they’re easier to maintain, easier to manage.=, typically. Our research shows that if properly managed, going back to our parents’ dorm rooms, or traditional residences is the right way to go. Of course, we do not advocate to dismiss the diversity of the student population and their needs. But for majority of the student body, which is where my perspective is coming from, I’m not talking necessarily about people with different abilities, or neurodiversity. But for the average student, we found the traditional rooms seemed to be the answer. And that for our research group working with universities and developers, what’s next is we’re going to be looking to shape the future of housing together to focus on students’ wellbeing, trying to bring the conversation around to a student-centric approach rather than only an internal rate of return approach. And that we’re in the process of publishing some new findings that I’ve mentioned today, and taking the work to more specific groups. We’re going to be looking at international students. So I’ll wrap up by saying that in this new work that we’re looking at, we found comparing socializing residences, single apartments, as I said on campus, was that people that lived in single apartments are the most expensive and luxurious ones on campus perform nine points worse, single modified traditional rooms, which is a room with a bathroom inside of it, they actually perform three points worse. As soon as you take that bathroom and put it in, they’re not performing with it as well. But if you did not want to have a single room only, students that live in multiple apartments where they are sharing with a group of four or five students, an apartment environment, although they perform worse than ones in traditional rooms, that is sort of the next-best group again, because of those social interactions that they’re having. Interestingly, we were surprised by this result, that single modified traditional were sort of three-points rooms, but as soon as you had a friend in your room with you, that then I guess, encouraged social interaction, that they only performed a little bit worse than the single room. We would generally advocate for small private bedrooms, but would allow for students to have a place that they can be quiet in, but that if they wanted to have more space that they would be encouraged to go out into their environment to interact with.

Rebecca: Well, thank you so much for sharing your really interesting research. As a designer, I find all this super fascinating.

John: Thank you, and it’s really nice to see some studies of these types of things rather than decisions being made based on perceived student preferences, which may not always align with what students will choose when faced with the cost, or when institutions are aware of what some of the implications are in terms of student retention and student success. So it’s nice to see this research being done.

Shelagh: Well, thanks so much for having me, John and Rebecca. I know, as a architect and a planner, I’m always looking for the data and how it can influence design. And speaking recently, at a conference, there were a number of architects that came up to me afterwards and said, “You must have seen so many residents” and I was like, “happy to have a lunch and learn,” we really want to do applied research, and just sort of see what is something that is concerning to us, and then be able to see if we can actually put a framework classification, allow people to investigate into this further. So maybe someone listening to this will also feel better about how they will be housing their student as they move into university. But then also, if there’s other researchers that are listening to this to say, maybe there’s an interdisciplinary way that they can come together with the tools that we’ve done, to be able to think about increasing the conversation into many other fields. Thank you so much for having me.

John: Thank you.

Rebecca: Thank you so much.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

329. Admission to Highly Selective Colleges

Graduates from a small number of elite private colleges account for a disproportionate share of America’s business and political leaders. In this episode, John Friedman joins us to discuss his recent study with Raj Chetty and David Deming that examines how admissions criteria at these institutions privilege students from high-income families.

John is the Briger Family Distinguished Professor of Economics and International Public Affairs at Brown University, where he is the chair of the Economics Department. He is a Research Associate at the National Bureau of Economic Research and has served in the White House as Special Assistant to the President for Economic Policy at the National Economic Council. John is also a member of the U.S. Treasury Council on Racial Equity, a co-Editor of the American Economic Review, and a founding Co-Director of Opportunity Insights.

Show Notes

Transcript

John K: Graduates from a small number of elite private colleges account for a disproportionate share of America’s business and political leaders. In this episode, we discuss a recent study that looks at how admissions criteria at these institutions privilege students from high-income families.

[MUSIC]

John K: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by

John K:, an economist…

John K: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John K: Our guest today is John Friedman. John is the Briger Family Distinguished Professor of Economics and International Public Affairs at Brown University, where he is the chair of the Economics Department. He is a Research Associate at the National Bureau of Economic Research and has served in the White House as Special Assistant to the President for Economic Policy at the National Economic Council. John is also a member of the U.S. Treasury Council on Racial Equity, a co-Editor of the American Economic Review, and a founding Co-Director of Opportunity Insights. Welcome.

John F: Thank you so much for having me. It’s a pleasure to be with you.

Rebecca: Today’s teas are: … John, are you drinking any tea with us today?

John F: So, I’m a big tea drinker…

Rebecca: Yay!

John F: …but, I drink tea in the morning. And so I had a delightful Hunan tea this morning, which I will draw on the reserves of that energy throughout this conversation.

Rebecca: Well played. [LAUGHTER]

John K: And I am drinking a ginger peach black tea from the Republic of Tea. Not so fancy, but I enjoy it.

Rebecca: I have an Awake tea because I also need some energy. [LAUGHTER]

John K: We’ve invited you here today to discuss your 2023 working paper with Raj Chetty and David Deming, “Diversifying Societies leaders: The Determinants and Causal Effects of Admission to Highly Selective Private Colleges.” This paper created a big stir in higher ed and other circles as well. You note in this study that less than one half of 1% of college students attend Ivy plus institutions. While most of our listeners will be familiar with Ivy League colleges, what are the other colleges that are included in the Ivy plus designation?

John F: Thanks. And it’s helpful to clarify up front, the colleges that we’re directly studying are the eight Ivy League schools: Harvard, Yale, Princeton, Dartmouth, Brown, Columbia, Princeton, Penn, and four close peers which are Stanford, MIT, Duke, and Chicago. The important thing to know here, you’re right, that there’s a pretty small share of students, it’s not that something changes discreetly, when you move out of that group of 12 schools, and you go to another outstanding private institution like Northwestern or Johns Hopkins or something like that. We have some data, it seems like there’s some pretty similar things going on across a lot of these very highly selective private institutions. Where you do see things being quite different, where we have some data as well, is at the most elective public institutions, places like UC-Berkeley, University of Michigan, UT-Austin, places like that.

John K: You still have to draw the line somewhere when you have prestigious institutions.

John F: That’s right.

Rebecca: So you noted that these institutions enroll a small share of our students, why are they so important? Why do we need to study them?

John F: That’s right, less than 1% of college students in the country go to one of these schools. And, of course, college students themselves are just a small share of students born in any given cohort. What we found, though, was that students from these institutions are really highly over represented in leadership positions in society. You see that if you look at who’s at the top of the income distribution, or who’s a CEO of a Fortune 500 company. More than 10% of those individuals are from these Ivy plus institutions. But it even gets higher when you look at who’s in the U.S. Senate. About three-quarters of the Supreme Court justices over the past 50 years have come from the schools. And so for sure, the schools themselves are not going to be making broad scale changes in upward mobility in our society. They’re just too small. But in terms of creating both a diverse group of leaders and a broad set of pathways, where children from any background have the chance to be a Senator or Supreme Court Justice, whatever, these schools are incredibly important.

John K: One of the things that your study did is it investigated questions that couldn’t be investigated before because of the data that you were able to assemble. Could you tell us a little bit about the data set that you use?

John F: Sure, our study, like so many others, has been the beneficiary of the big data revolution. It’s affected so many aspects of society, and this is the academic part of it. We’re merging together datasets from three different places. The starting point for this paper and for many of my other research is the universe of U.S. tax and census records, which have been merged together at the US Census Bureau. And what that allows us to do is to identify individuals when they’re kids and then actually follow them through to not just project what we think their outcomes might be, but really actually observe them after they get out of college and they’ve entered the labor force. Those data are incredibly important in terms of measuring upward mobility directly. Then, on top of that, in order to study really in depth what’s going on at these institutions, we have internal admissions data from several Ivy plus colleges as well as a bunch of these most selective public universities and university systems. And we see where children are coming from, or where they grew up in the tax data, we see where they end up in the tax data, the college data are really filling in this in between, how do they go through the college application process. We both learn a lot of other information about them, like where they applied, there’s a lot of detail about the evaluations of their applications, as well as of course, whether they eventually get in and matriculate. The final data that we’re using is a set of standardized test scores from the two main testing companies: College Board that runs the SAT, and then ACT, which runs the eponymous test. And the way we use those data are to start from a baseline of academic achievement at the point when these students are applying to university. And we can talk about how that works, and of course, it’s not a perfect proxy for where students are. But when we think about the role that universities are going to be able to play, we just have to be realistic about the fact that they are starting to interact with students when they’re 17 or 18, and there’s a whole lot of inequality in our country that’s going to affect students long before that. And so we talk, of course, as a policy matter about how to deal with all that inequality. But the reality of the situation, especially at this highly selective level, there are going to be some students that just aren’t academically prepared. So that’s going to shape the set of students that these colleges can recruit or admit.

Rebecca: One of the main questions that you address in the paper is: “Do highly selective colleges amplify the persistence of privilege across generations by taking students from high income families and helping them obtain high-status. high-paying, leadership positions?” What do your results suggest?

John F: So that’s exactly the kind of broad goal of our paper, to answer that question. And I think, unfortunately, the answer is that on average, yes, they do amplify the persistence of privilege. That comes from two different parts. So first of all, the students who attend these colleges, we measure a pretty large causal effect on their outcomes, specifically in these leadership positions as adults. Of course, the students are very highly selected when they come in. And so even if the college’s weren’t doing anything, you’d expect these set of students to be doing some impressive things afterwards. But what we find when we talk about more of the details of how we do this later, there’s a very large causal effect. And so these universities, it’s not just that a large share of senators come from them, they do seem to be a very important pipeline effect, where it’s really propelling students up into these leadership positions. Now, on the admission side, who are the students that are coming into this set of institutions that are benefiting from this really positive effect? The problem here is that even relative to the distribution of test scores for high school graduating seniors, which as we talked about before, exhibit a whole amount of inequality due to differences in education and neighborhoods that different students from different backgrounds have been exposed to before they’re applying to college. Even just looking at students that have the very same test scores, high-income students are substantially more likely to be admitted to and attend these institutions, relative to lower-income students, and especially middle-income students. The gaps are largest when comparing students from very high-income families to students from middle-class, upper-middle class families.

John K: And in your study, you tie some of this selection process to athletic scholarships, to legacy students, as well as attendance at private high schools. Could you talk a little bit about how those factors influenced the decisions?

John F: Sure. So the approach that we take is a decomposition of this pipeline, we see that students are coming in with, let’s just say everybody has the same test score, a group of students at the beginning, we see that the students from high-income families are more likely to end up attending this set of schools at the end of the day, and we’re going to try to decompose where in the pipeline these disparities are emerging. And so the way we first start is actually at a somewhat higher level than you asked the question, which is just to decompose these differences between the application phase, which of the set of students with a given test score applies to these institutions, the admissions phase of those students with that given set of test scores that applied which are admitted, and then the matriculation or the yield phase of those that are admitted whose actually going to choose to come at the end of the day? And what I found interesting coming into this project is that there are many different analyses or ideas about how each of those three phases could be affecting it. There’s concerns about who has the information or the resources to apply. There’s concerns about potential biases in the admissions process from some of the factors that you mentioned, legacy preferences or private schools. And there’s a concern that maybe schools aren’t offering financial aid that’s sufficient in order for students from less affluent families to attend. In our data, we see that about two-thirds of that entire disparity is coming from the admissions part of that alone. So that’s not all of it. But I mean, just to give some numbers, there are about 250 students from the top 1% of the parental income distribution who are in an average starting first-year class, that’s about 1650 students. So right there, about 15% of the class is coming from the top 1% of families. Of those 250, we find that about 160 of them are extra in the sense that if everyone attended at the same rate, when they have the same test score, there would only be about 90 students from the top 1% of families. And so then of that 160, about 100 are coming from the fact that high-income students are more likely to be admitted. There are smaller effects coming from differences in application rates, even smaller effects coming from differences in matriculation rates. But primarily, the differences are coming through the admissions process. And even before we get into specific policies, I think that that decomposition is incredibly important, because the admissions process is the one part of this that schools entirely control themselves. If you want more people to apply to your school, that’s hard, because applications are the students’ decision, you have to go out and convince a bunch of students to apply. If you want to get more students to yield, to matriculate, you have to convince those students, it’s their decision. The choice about who to admit, it’s just the school’s choice. This is the one lever that the schools entirely control. And so the fact that most of the disparities are explained by this set of policies, on the one hand, maybe that’s a good thing that they control, and maybe can directly fix what is the source of the problem. On the other hand, it’s a little bit discouraging that it’s in the choice of these own universities that these disparities are being created, despite what are typically loudly voiced concerns for upward mobility. So it’s really the admissions process that matters. Now, we then go down to the next level. and this gets to the factors that you mentioned. Why is it that a high-income student with a 1400 test score is going to be admitted at a higher rate than a middle-income student or a low-income student with a 1400 test score. And even just to start with, in some sense, the dog that didn’t bark here, you might have thought that students with a 1400 from low-income families, they might even be more impressive that they got to that level despite facing all of these barriers, but we see that admissions rates are in fact much higher for high-income students. And we trace that back to three factors. The first and most important factor up 40% of what’s going on is the preference for legacy students. Those are students who are children of alumni of the institution. Now, legacy students affect the admissions rate of high-income individuals for two reasons. One is pretty obvious, the alumni of these institutions themselves are just much more likely to be high income. That’s kind of the generation before, we’re getting the same positive effect of attendance. But the second reason, I think, was a little bit more surprising to me. It turns out that legacy students from high-income families receive a substantially larger admissions boost, even then, legacies from lower-income families. So there’s kind of a preference for high-income students, even within the legacy pool. And you put those two things together, and that accounts for about 40% of the admissions difference. The second factor is the fact that all of these schools designate about somewhere between 12 and 15% of their class for athletic recruits. Now, there’s nothing inherent in athletics, that means that it has to be students from high-income families. And in fact, if you look at the distribution of athletic recruits at public universities, those students mirror the income distribution of most of the other students at the school, in the sense that there’s not a tilt towards high-income families. But at private institutions, the share of admitted students that are athletic recruits among high-income families is significantly higher… more like 13-14%… than It is among admitted students from low-income families where only 5 or 6% of those students are athletes. Now, why is this the case? I was an athlete in college myself, and I don’t think that it’s just because kids from higher-income families are more athletically talented. I think it has to do first with the resources that are available to these kids. Becoming a college baseball player isn’t just about having good hand-eye coordination, it’s about being able to attend clinics, being part of a travel team, there’s like a lot of stuff that goes along with being able to get to that level. And then I think the second factor is that the set of sports that are offered by many of these institutions go well beyond the canonical football, basketball, baseball, which may be a little bit more broad base, but they also include sports like water polo, or sailing or equestrian. And these are sports where I’m sure that there are examples of athletes from all across the income distribution, but think they tend to skew towards more high-income families. So athletic recruits are the second major chunk. And then the third is what my friend David Leonhardt at the New York Times likes to call private school polish. A lot of what the schools focus on in the admissions process goes beyond just how academically prepared people are, and they really like to see somebody who’s doing interesting things that could be as part of extracurriculars, that could be the way they spend their summer, could be the way that teachers write about the students or the guidance counselors write about the students. And all of this gets channeled through a student’s evaluation on non-academic factors. And what we see there is that not only are students from high-income families much more likely to get very strong non-academic ratings, that seems to flow through through things like recommendation letters that are really centered at the school level. And just more generally, you find if you compare high- and low-income students who are attending the same school, you no longer see this disparity in non academic ratings. And so our sense is that these other broader factors that kind of seep into the admissions process are accounting for the third leg of this tripod that’s giving high-income students an advantage in the admissions process.

John K: And some parents are probably sending their students to more elite private schools in the hope that that will enhance their prospects. And the schools that accept them recognize that one of the reasons students are going there is because they prepare them better for selection in a more prestigious institution.

John F: I think that’s exactly right. I think it’s not just parents and schools, the thought that colleges place a substantial weight on these non-academic factors, which then can be kind of trained for and developed over the years, I think this is really a major force that shapes the way that parents and kids and lots of organizations in society direct their resources. So let me just give you an example here. I was presenting this paper at UC Berkeley in the economics department and a friend of mine who lives in San Francisco, who’s a professor there sent me a picture of an advertisement on the side of the road, like kind of billboard on the side of the road, for a fencing academy. It’s called the Saber School. And it says “a safe, fun sport that will help: what are the things that doing saber will help?” Well, number one, it will enhance performance at work and school. Okay, that sounds plausible. Number two, it will enhance speed, coordination, and decisiveness. Number three, it will help you get accepted at top US colleges, just like right there on the billboard. And so if you want to fence as a kid, that’s totally fine, and some people are gonna really enjoy it. But the fact that colleges value this and so now all sorts of people are spending their time fencing simply because they think it will help their college application, I find that to be a little bit silly.

Rebecca: I don’t think we would have found that billboard in my neighborhood. [LAUGHTER]

John K: Although if you brought a saber to work, [LAUGHTER] you might get more attention.

John F: That raises a host of other issues. [LAUGHTER]

Rebecca: In your study, you also examined admission rates at highly selective public colleges. Do their admissions also favor students from high-income households over lowincome households when other student characteristics are held constant?

John F: Yeah, so the public most selective institutions, they provide a really interesting contrast to the private schools, and there are really two differences. The first difference is that it’s still true that students from high-income families with the same test score are more likely to be attending these places like UC Berkeley or Michigan than students from lower-income families. But it’s not the super concentration in the top 1%, the top 1% are about 20% more likely to attend, but so are the top 5% And roughly top 10%. It’s more kind of a broad top of the income distribution than kid of the uber rich that are benefiting from this. Then second, when you do the decomposition that we do at the private schools, you find that, in fact, it’s not the admissions process, the chances of admission for students with a given test score are almost identical across the income distribution, if anything slightly higher for lower-income students. The big differences come in the fraction of students who apply to these schools. You see almost all of the over attendance is explained by higher application rates of high-income students. And so that really points to a very different part of pipeline. And I think there’s a whole other set of issues that in kind of policy concerns that that brings up, just to cite some fantastic work in this space by my colleague at Harvard, Sue Dynarski, she and a number of co-authors have worked with the University of Michigan over the past 10 years, on something called the Hail scholarship. And this program is really focused on this application phase where they reach out to students who are doing very well in Michigan Public Schools, and who are not from high-income families. And they not just inform the students about the University of Michigan, but they provide a simplified form of financial aid, that’s a tiny bit more generous, but just mostly clearer, that’s basically guaranteed zero for four years. And that seems to have really large effects, big increases in the share of students who are applying who receive these types of fliers, that then carries through to those that are admitted and those that end up matriculating. And so, first of all, it’s really interesting that there are sometimes different problems at these different schools. But also, I think it’s a nice lesson that even among two different schools, which are objectively at the very top of the U.S. higher educational sector, there are really important differences in terms of how these different institutions operate, and what types of policies are going to be most appropriate for increasing diversity of students and social mobility at those places.

John K: Is the rate of return to education significantly different between the Ivy plus institutions and elite public institutions?

John F: The answer is yes. But it’s different in a very particular way. So in our data, what we find, using a bunch of different empirical approaches, is that students that attend these Ivy plus institutions are significantly more likely to be at the very top of the income distribution to attend an elite graduate school, to hold a very prestigious job. They’re much more likely to do that than students who attend the very most selective of the public institutions. Those public institutions, in turn, are significantly better at propelling students to these leadership positions than lower rated less selective public institutions. And so it is both true that those public institutions are very good, and also true that these Ivy plus schools are really quite a bit better. That’s focusing on these top end leadership positions. If you look instead at something like what’s the chance that you’ll be in the top 20% of the income distribution, so for kids in their early 30s, that’s earning more than about $60,000. So that’s a good solid, professional job, you don’t have to be a hedge fund manager, there, attending these Ivy plus schools is not really going to make that much of a difference. And the reason is that at that point in the income distribution, that’s just not what the schools are designed for. You’re quite likely to get a job that’s going to pay more than that from an Ivy League school, you’re also quite likely to get a job that pays more from that at one of these elite public institutions. There are differences in average income, but it’s really driven by this kind of a lottery ticket that you’re getting on maybe you’re going to be really just an extreme leader, again, either very top of the income distribution, very prestigious firm. So the answer is yes, these schools differ, but they primarily differ in this particular way, which is why we’ve placed the emphasis on leadership rather than just kind of broad economic security. It’s not clear that students from Ivy plus schools are just broadly more economically secure in that middle of the income distribution than those from public schools.

John K: You also examine in this paper what would be the effects if the admission process at the more elite institutions were similar to that at highly selective public institutions? What do you find there in terms of the income diversity of students in the Ivy plus institutions if those preferences were eliminated?

John F: Yeah. So we’re able to simulate, exactly as you say, what would these classes look like at least probabilistically, if the admissions office were to place less weight on some of these factors, and it makes a meaningful difference. So just to give you one statistic, currently, on average, there are a bit less than 60% of students at these schools that come from the bottom 95% of the income distribution. Those are families making less than call it $250,000 A year. If you were to get rid of all these three preferences that I’ve talked about, if you were to remove preferences for legacy students, just to be clear on what that means, we’re just going to admit them based on all the other characteristics, oftentimes they’re great students, but we’re just not going to give them an extra boost for being a legacy student. If we were to remove this seeming bias that arises in the process where higher-income students are getting stronger non-academic ratings, and if you were to not necessarily remove athletics, but just make the athletes look like all the other students, so there’s not this tilt towards high-income students among athletes, you would increase the share of students from the bottom 95%, from a bit less than 60 up to about 70%, a bit less than 70. And so what does that mean in practice, again, there are about 1600, 1650 students in the average entering first-year class, we’re talking about another 150 to 160 students from more modest backgrounds. And, of course, this is not an enormous change. But it’s on the same order, as people are talking about when we think about what’s the difference in student bodies that might come from changes in racial preferences in admissions flowing from the Supreme Court decision. It’s on a similar magnitude. We’re gonna have 100, maybe 150, fewer students of color on campus. And I think it not only affects the diversity on campus, I think it also meaningfully affects the role that these schools are playing in upward mobility, particularly to these leadership positions. You make some admittedly heroic assumptions and kind of flow things through, this type of change is going to make another two or three US senators from the middle class instead of from very high-income backgrounds. And let’s not overstate this, like it’s only two or three senators, but for a set of decisions that literally 12 People can decide to make if they want to. I think that’s pretty impressive. And that doesn’t even think about well, what if the Northwesterns and the NYUs of the world decided to make some of these changes as well. So my sense is that we’re not going to remake society by doing this, but it’s a pretty low-hanging fruit. And the thing to say is it just from a policy perspective, you can achieve the same differences in the admissions pool, either by getting rid of the preferences that are afforded to high-income students, or by introducing new preferences that benefit students from low- and middle-income families that are particularly academically strong. And what we show in the paper, we kind of calibrated, we say like, if you were to introduce a new preference, specifically designed to get exactly the same mix of students that you would get from eliminating these preferences, what you would need is a preference for low- and middle-income students that’s is weaker than the preference even that current admissions offices put in place for legacy students. So legacy students, on average, are about three or four times more likely to be admitted, you’d need really strong academic students from low- and middle-income backgrounds to be, on average, about twice as likely to be admitted. And that would be a big change. But it’s not like these are changes that go well beyond the type of preferences that are already in place in the admissions process,

Rebecca: …and seemingly pretty actionable. [LAUGHTER]

John F: Yeah, and look, I think that this is a particular moment of fluidity in higher education admissions. Because of the Supreme Court decision, people are not just reconsidering how to think about diversity. That’s kind of the direct effect. But once you open up the gearbox, I think it then becomes natural to rethink a lot of different things when it comes to admissions, both because once there’s a process, it’s easier to think about other stuff. And also because I think that having a preference for students from overwhelmingly high-income families becomes increasingly awkward when you’re no longer allowed to give preferences for students who are clearly experiencing very large disparities in the run up to college. So I think almost all colleges are really strongly considering a bunch of this stuff. Some of them are doing so in publicly announced committees. Here at Brown University, I serve on a committee, including both faculty and trustees that are thinking about a bunch of these issues. Other universities are doing it more internally, only trustees, maybe it includes students. All the universities are doing this in a different set of ways. And I wouldn’t be surprised if we see more change in the way college admissions works over the next year or two than we’ve seen in a long time. And so yeah, hard to know what will happen, but these are an incredibly important set of issues to consider and I hope we’ve been able to contribute to that debate. As an academic, all you can ask for is that people will listen, policies, it’s up to them. There’s a lot of factors that go into that go beyond the research. But we’ve been really, both in public and had a lot of conversations with university leaders about how to think about these issues. So whatever the decision is, I’m confident it will be made on the basis of what I hope is a better set of analyses and understanding for what’s going on than we had before.

John K: Before, I think everyone expected that these types of results were occurring, but I don’t think it was really clear how large the magnitude was. And your study certainly contributes to that knowledge. Having data like this, and these results, I think, will put more pressure on institutions to change than just the general suspicion that they were privileging a very elite group of students. One of the things you note in the study is that making these changes will lead to a more diverse leadership pool, but it may not have as much of an effect on intergenerational income mobility. Could you talk a little bit about that?

John F: That’s exactly right. And I think that stems from some of the themes we’ve been talking about, where the role that these schools play in intergenerational mobility to leadership positions, that’s potentially very large. But they’re just too small to play a role in addressing some of the very broad differences in equality of opportunity that we see in this country, other than through kind of the indirect channel, which is that I think when you have individuals in these leadership positions that come from a broader range of backgrounds, you’re more likely to get policy that’s made in a way that takes into account some of these effects. And so that actually leads to some of the research that we’re really now focusing on, which is that, when you think about intergenerational mobility and higher education, an initial paper that I wrote on this, decomposed the problem into what we called access, that’s who’s attending and the success, what happens to the students that attend, you need both of them to be working together to have intergenerational mobility. If either of them is absent, then you have less mobility. And what we found was that different types of institutions seem to have problems in different areas. So institutions that were highly selective, not only the Ivy plus institutions, but honestly also some of the public institutions in the country, their lack of effect on mobility, in large part, was coming from the relatively un-diverse set of students on an income dimension that were attending their school. Many of these schools, again, both public and private, the share of students come from the bottom 20% of the income distribution is really just 3 or 4%. Really not large at all. So we really wanted to separate the question for these institutions of how do you improve mobility through increasing access with the situation for what is a very different set of institutions, not just the elite public institutions, but some of the open-access institutions, the community colleges where there, not that access can’t be improved, but I think much more the problem is that, in many cases, students are attending these institutions and not being propelled upwards in the income distribution in the way that we would hope. And so that’s really now what we’re focusing on: How can we first measure, in a very broad way, what these different institutions and programs are doing in order to propel students up the income ladder, to really give them the skills, the human capital, the social capital, in order to get good paying jobs and move upwards after that in their career? And then what are the policy levers that you would pull in order to improve that? The way I like to think about this is suppose that you gave the governor of California $10 billion to improve upward mobility in education in his state. Would you want to get more people going to Cal State instead of the California Community Colleges? Is it important that you not only go to all Cal State, is it important that you go to a particular Cal State? Is it important that you have a particular program? Are some programs much more effective than others? Should we be encouraging more people to go to community colleges, even if that costs and has fewer people going to Cal State? Do we want more people to start at community colleges and transfer up to Cal State? Do we want more people to not start at community colleges, because it’s better if you start directly at Cal State? There’s all these different questions. And there’s been some great research on different aspects of it, but I think with the data that we have, we’re hoping to provide a more unifying framework to think about what are the particular places where there’s more or less success for students, again, defined as like the causal effect of attending these places. And how can we expose more students to high success environments, either by moving them around or by changing what the programs are?

John K: In your intro, we mentioned that you were a member of the U.S. Treasury Council on Racial Equity, and the Co-Director of Opportunity Insights. Could you talk a little bit about what these organizations do?

John F: So Opportunity Insights is a research and policy organization that I run jointly with my co-authors Nathan Hendren and Raj Chetty. And what we’re doing there is trying to put together a research agenda to understand upward mobility, both from an academic and a policy perspective. Research that involves this kind of big data has evolved over the last decades to almost look more like a science lab where it’s very team oriented. It’s not a professor and her keyboard or chalkboard just kind of plugging away in isolation anymore. And Opportunity Insights is a way for us to organize all of that team in terms of there are other faculty that we collaborate with, there are graduate students we collaborate with, there are research assistants we collaborate with, there are visitors at all different levels that we collaborate with. And so Opportunity Insights is really the organization through which we just do a lot of this research and try to translate it to help policymakers and whatever that means, depending on the research. The Treasury Advisory Council on Racial Equity is very, very different. Treasury is one of the largest agencies in the federal government. And it has many different policies that directly or indirectly affect racial equity in ways that are obvious or not obvious. And the purpose of this Advisory Council is to bring together people from many different aspects of society that are relevant to Treasury’s financial policymaking. So there are a couple of academics on the committee like me, but there are also people who run financial institutions, there are people who run nonprofits that deal with financial institutions, people who run non-financial institutions, more businesses. And the idea is to be a group that can both proactively offer suggestions to Treasury in terms of how they can change things either out of blue sky or on particular policies that are undergoing after policymaking, as well as a resource for them to turn to when they say look like we’re trying to figure out… an example is a lot of the focus of Treasury over the last two years has been the implementation of the IRA bill, which includes a lot of tax incentives for green investment. How can they implement all of those tax credits? How can they write all those regulations in a way that really does so to support racial equity, and to make sure that black and Hispanic and native individuals are not left behind in a way that, unfortunately, has been too often the case in our nation’s history. So that’s far from a full-time role. We meet once a quarter in public meetings and try to offer our suggestions. And even again, this suggestions span how Treasury should implement different regulations from even how Treasury can make research on racial equity more accessible, or make data more accessible to support more research so that there’s more broad knowledge when it comes time for policymaking.

Rebecca: You’re doing some really exciting and interesting things.

John F: Thank you.

Rebecca: Thanks so much for your work and sharing it with us today. But we always wrap up by asking: “What’s next?”

John F: So I talked about some of the work in the college space. But I’m trying to think about other parts of upward mobility as well, to understand how environments or policies contribute to these disparities or what policies can help alleviate them. And a big theme in some of my recent work is to try to broaden our measure of mobility to go beyond these purely economic measures. It’s a natural place to start, both because having a higher income is something that is kind of meaningfully related to the quality of one’s life and also because it’s pretty consistent data to measure income. But I think even economists will admit to you that income is not the end of it. And we’re trying to think about other ways, not only to measure people’s wellbeing thinking about health, thinking about social capital, for instance, but also to measure or folks influence on broader society. So there are positions like entrepreneurs or scientists, inventors, that if we generate more innovation in society, that’s not something that just benefits the individual inventor, it’s something that benefits society much more broadly. And so I think that’s not only very important as kind of an alternative economic outcome, but it’s important to thinking about why something like social mobility goes beyond merely thinking about well, each individual should have their fair chance of success. These are ways in which just society as a whole is better, more innovative, more engaged, when there’s more upward mobility. And in that way, I think it’s really a rising tide that can lift all boats. So that’s a little bit of what I’ve been thinking about recently.

John K: Well, thank you for taking the time to join us. We really enjoyed this conversation. And we really, as Rebecca said, appreciate all the work that you’ve been doing.

John F: Thank you so much. It’s really been a pleasure to talk with you about all this work over the last hour and I appreciate that.

[MUSIC]

John K: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]