329. Admission to Highly Selective Colleges

Graduates from a small number of elite private colleges account for a disproportionate share of America’s business and political leaders. In this episode, John Friedman joins us to discuss his recent study with Raj Chetty and David Deming that examines how admissions criteria at these institutions privilege students from high-income families.

John is the Briger Family Distinguished Professor of Economics and International Public Affairs at Brown University, where he is the chair of the Economics Department. He is a Research Associate at the National Bureau of Economic Research and has served in the White House as Special Assistant to the President for Economic Policy at the National Economic Council. John is also a member of the U.S. Treasury Council on Racial Equity, a co-Editor of the American Economic Review, and a founding Co-Director of Opportunity Insights.

Show Notes

Transcript

John K: Graduates from a small number of elite private colleges account for a disproportionate share of America’s business and political leaders. In this episode, we discuss a recent study that looks at how admissions criteria at these institutions privilege students from high-income families.

[MUSIC]

John K: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by

John K:, an economist…

John K: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John K: Our guest today is John Friedman. John is the Briger Family Distinguished Professor of Economics and International Public Affairs at Brown University, where he is the chair of the Economics Department. He is a Research Associate at the National Bureau of Economic Research and has served in the White House as Special Assistant to the President for Economic Policy at the National Economic Council. John is also a member of the U.S. Treasury Council on Racial Equity, a co-Editor of the American Economic Review, and a founding Co-Director of Opportunity Insights. Welcome.

John F: Thank you so much for having me. It’s a pleasure to be with you.

Rebecca: Today’s teas are: … John, are you drinking any tea with us today?

John F: So, I’m a big tea drinker…

Rebecca: Yay!

John F: …but, I drink tea in the morning. And so I had a delightful Hunan tea this morning, which I will draw on the reserves of that energy throughout this conversation.

Rebecca: Well played. [LAUGHTER]

John K: And I am drinking a ginger peach black tea from the Republic of Tea. Not so fancy, but I enjoy it.

Rebecca: I have an Awake tea because I also need some energy. [LAUGHTER]

John K: We’ve invited you here today to discuss your 2023 working paper with Raj Chetty and David Deming, “Diversifying Societies leaders: The Determinants and Causal Effects of Admission to Highly Selective Private Colleges.” This paper created a big stir in higher ed and other circles as well. You note in this study that less than one half of 1% of college students attend Ivy plus institutions. While most of our listeners will be familiar with Ivy League colleges, what are the other colleges that are included in the Ivy plus designation?

John F: Thanks. And it’s helpful to clarify up front, the colleges that we’re directly studying are the eight Ivy League schools: Harvard, Yale, Princeton, Dartmouth, Brown, Columbia, Princeton, Penn, and four close peers which are Stanford, MIT, Duke, and Chicago. The important thing to know here, you’re right, that there’s a pretty small share of students, it’s not that something changes discreetly, when you move out of that group of 12 schools, and you go to another outstanding private institution like Northwestern or Johns Hopkins or something like that. We have some data, it seems like there’s some pretty similar things going on across a lot of these very highly selective private institutions. Where you do see things being quite different, where we have some data as well, is at the most elective public institutions, places like UC-Berkeley, University of Michigan, UT-Austin, places like that.

John K: You still have to draw the line somewhere when you have prestigious institutions.

John F: That’s right.

Rebecca: So you noted that these institutions enroll a small share of our students, why are they so important? Why do we need to study them?

John F: That’s right, less than 1% of college students in the country go to one of these schools. And, of course, college students themselves are just a small share of students born in any given cohort. What we found, though, was that students from these institutions are really highly over represented in leadership positions in society. You see that if you look at who’s at the top of the income distribution, or who’s a CEO of a Fortune 500 company. More than 10% of those individuals are from these Ivy plus institutions. But it even gets higher when you look at who’s in the U.S. Senate. About three-quarters of the Supreme Court justices over the past 50 years have come from the schools. And so for sure, the schools themselves are not going to be making broad scale changes in upward mobility in our society. They’re just too small. But in terms of creating both a diverse group of leaders and a broad set of pathways, where children from any background have the chance to be a Senator or Supreme Court Justice, whatever, these schools are incredibly important.

John K: One of the things that your study did is it investigated questions that couldn’t be investigated before because of the data that you were able to assemble. Could you tell us a little bit about the data set that you use?

John F: Sure, our study, like so many others, has been the beneficiary of the big data revolution. It’s affected so many aspects of society, and this is the academic part of it. We’re merging together datasets from three different places. The starting point for this paper and for many of my other research is the universe of U.S. tax and census records, which have been merged together at the US Census Bureau. And what that allows us to do is to identify individuals when they’re kids and then actually follow them through to not just project what we think their outcomes might be, but really actually observe them after they get out of college and they’ve entered the labor force. Those data are incredibly important in terms of measuring upward mobility directly. Then, on top of that, in order to study really in depth what’s going on at these institutions, we have internal admissions data from several Ivy plus colleges as well as a bunch of these most selective public universities and university systems. And we see where children are coming from, or where they grew up in the tax data, we see where they end up in the tax data, the college data are really filling in this in between, how do they go through the college application process. We both learn a lot of other information about them, like where they applied, there’s a lot of detail about the evaluations of their applications, as well as of course, whether they eventually get in and matriculate. The final data that we’re using is a set of standardized test scores from the two main testing companies: College Board that runs the SAT, and then ACT, which runs the eponymous test. And the way we use those data are to start from a baseline of academic achievement at the point when these students are applying to university. And we can talk about how that works, and of course, it’s not a perfect proxy for where students are. But when we think about the role that universities are going to be able to play, we just have to be realistic about the fact that they are starting to interact with students when they’re 17 or 18, and there’s a whole lot of inequality in our country that’s going to affect students long before that. And so we talk, of course, as a policy matter about how to deal with all that inequality. But the reality of the situation, especially at this highly selective level, there are going to be some students that just aren’t academically prepared. So that’s going to shape the set of students that these colleges can recruit or admit.

Rebecca: One of the main questions that you address in the paper is: “Do highly selective colleges amplify the persistence of privilege across generations by taking students from high income families and helping them obtain high-status. high-paying, leadership positions?” What do your results suggest?

John F: So that’s exactly the kind of broad goal of our paper, to answer that question. And I think, unfortunately, the answer is that on average, yes, they do amplify the persistence of privilege. That comes from two different parts. So first of all, the students who attend these colleges, we measure a pretty large causal effect on their outcomes, specifically in these leadership positions as adults. Of course, the students are very highly selected when they come in. And so even if the college’s weren’t doing anything, you’d expect these set of students to be doing some impressive things afterwards. But what we find when we talk about more of the details of how we do this later, there’s a very large causal effect. And so these universities, it’s not just that a large share of senators come from them, they do seem to be a very important pipeline effect, where it’s really propelling students up into these leadership positions. Now, on the admission side, who are the students that are coming into this set of institutions that are benefiting from this really positive effect? The problem here is that even relative to the distribution of test scores for high school graduating seniors, which as we talked about before, exhibit a whole amount of inequality due to differences in education and neighborhoods that different students from different backgrounds have been exposed to before they’re applying to college. Even just looking at students that have the very same test scores, high-income students are substantially more likely to be admitted to and attend these institutions, relative to lower-income students, and especially middle-income students. The gaps are largest when comparing students from very high-income families to students from middle-class, upper-middle class families.

John K: And in your study, you tie some of this selection process to athletic scholarships, to legacy students, as well as attendance at private high schools. Could you talk a little bit about how those factors influenced the decisions?

John F: Sure. So the approach that we take is a decomposition of this pipeline, we see that students are coming in with, let’s just say everybody has the same test score, a group of students at the beginning, we see that the students from high-income families are more likely to end up attending this set of schools at the end of the day, and we’re going to try to decompose where in the pipeline these disparities are emerging. And so the way we first start is actually at a somewhat higher level than you asked the question, which is just to decompose these differences between the application phase, which of the set of students with a given test score applies to these institutions, the admissions phase of those students with that given set of test scores that applied which are admitted, and then the matriculation or the yield phase of those that are admitted whose actually going to choose to come at the end of the day? And what I found interesting coming into this project is that there are many different analyses or ideas about how each of those three phases could be affecting it. There’s concerns about who has the information or the resources to apply. There’s concerns about potential biases in the admissions process from some of the factors that you mentioned, legacy preferences or private schools. And there’s a concern that maybe schools aren’t offering financial aid that’s sufficient in order for students from less affluent families to attend. In our data, we see that about two-thirds of that entire disparity is coming from the admissions part of that alone. So that’s not all of it. But I mean, just to give some numbers, there are about 250 students from the top 1% of the parental income distribution who are in an average starting first-year class, that’s about 1650 students. So right there, about 15% of the class is coming from the top 1% of families. Of those 250, we find that about 160 of them are extra in the sense that if everyone attended at the same rate, when they have the same test score, there would only be about 90 students from the top 1% of families. And so then of that 160, about 100 are coming from the fact that high-income students are more likely to be admitted. There are smaller effects coming from differences in application rates, even smaller effects coming from differences in matriculation rates. But primarily, the differences are coming through the admissions process. And even before we get into specific policies, I think that that decomposition is incredibly important, because the admissions process is the one part of this that schools entirely control themselves. If you want more people to apply to your school, that’s hard, because applications are the students’ decision, you have to go out and convince a bunch of students to apply. If you want to get more students to yield, to matriculate, you have to convince those students, it’s their decision. The choice about who to admit, it’s just the school’s choice. This is the one lever that the schools entirely control. And so the fact that most of the disparities are explained by this set of policies, on the one hand, maybe that’s a good thing that they control, and maybe can directly fix what is the source of the problem. On the other hand, it’s a little bit discouraging that it’s in the choice of these own universities that these disparities are being created, despite what are typically loudly voiced concerns for upward mobility. So it’s really the admissions process that matters. Now, we then go down to the next level. and this gets to the factors that you mentioned. Why is it that a high-income student with a 1400 test score is going to be admitted at a higher rate than a middle-income student or a low-income student with a 1400 test score. And even just to start with, in some sense, the dog that didn’t bark here, you might have thought that students with a 1400 from low-income families, they might even be more impressive that they got to that level despite facing all of these barriers, but we see that admissions rates are in fact much higher for high-income students. And we trace that back to three factors. The first and most important factor up 40% of what’s going on is the preference for legacy students. Those are students who are children of alumni of the institution. Now, legacy students affect the admissions rate of high-income individuals for two reasons. One is pretty obvious, the alumni of these institutions themselves are just much more likely to be high income. That’s kind of the generation before, we’re getting the same positive effect of attendance. But the second reason, I think, was a little bit more surprising to me. It turns out that legacy students from high-income families receive a substantially larger admissions boost, even then, legacies from lower-income families. So there’s kind of a preference for high-income students, even within the legacy pool. And you put those two things together, and that accounts for about 40% of the admissions difference. The second factor is the fact that all of these schools designate about somewhere between 12 and 15% of their class for athletic recruits. Now, there’s nothing inherent in athletics, that means that it has to be students from high-income families. And in fact, if you look at the distribution of athletic recruits at public universities, those students mirror the income distribution of most of the other students at the school, in the sense that there’s not a tilt towards high-income families. But at private institutions, the share of admitted students that are athletic recruits among high-income families is significantly higher… more like 13-14%… than It is among admitted students from low-income families where only 5 or 6% of those students are athletes. Now, why is this the case? I was an athlete in college myself, and I don’t think that it’s just because kids from higher-income families are more athletically talented. I think it has to do first with the resources that are available to these kids. Becoming a college baseball player isn’t just about having good hand-eye coordination, it’s about being able to attend clinics, being part of a travel team, there’s like a lot of stuff that goes along with being able to get to that level. And then I think the second factor is that the set of sports that are offered by many of these institutions go well beyond the canonical football, basketball, baseball, which may be a little bit more broad base, but they also include sports like water polo, or sailing or equestrian. And these are sports where I’m sure that there are examples of athletes from all across the income distribution, but think they tend to skew towards more high-income families. So athletic recruits are the second major chunk. And then the third is what my friend David Leonhardt at the New York Times likes to call private school polish. A lot of what the schools focus on in the admissions process goes beyond just how academically prepared people are, and they really like to see somebody who’s doing interesting things that could be as part of extracurriculars, that could be the way they spend their summer, could be the way that teachers write about the students or the guidance counselors write about the students. And all of this gets channeled through a student’s evaluation on non-academic factors. And what we see there is that not only are students from high-income families much more likely to get very strong non-academic ratings, that seems to flow through through things like recommendation letters that are really centered at the school level. And just more generally, you find if you compare high- and low-income students who are attending the same school, you no longer see this disparity in non academic ratings. And so our sense is that these other broader factors that kind of seep into the admissions process are accounting for the third leg of this tripod that’s giving high-income students an advantage in the admissions process.

John K: And some parents are probably sending their students to more elite private schools in the hope that that will enhance their prospects. And the schools that accept them recognize that one of the reasons students are going there is because they prepare them better for selection in a more prestigious institution.

John F: I think that’s exactly right. I think it’s not just parents and schools, the thought that colleges place a substantial weight on these non-academic factors, which then can be kind of trained for and developed over the years, I think this is really a major force that shapes the way that parents and kids and lots of organizations in society direct their resources. So let me just give you an example here. I was presenting this paper at UC Berkeley in the economics department and a friend of mine who lives in San Francisco, who’s a professor there sent me a picture of an advertisement on the side of the road, like kind of billboard on the side of the road, for a fencing academy. It’s called the Saber School. And it says “a safe, fun sport that will help: what are the things that doing saber will help?” Well, number one, it will enhance performance at work and school. Okay, that sounds plausible. Number two, it will enhance speed, coordination, and decisiveness. Number three, it will help you get accepted at top US colleges, just like right there on the billboard. And so if you want to fence as a kid, that’s totally fine, and some people are gonna really enjoy it. But the fact that colleges value this and so now all sorts of people are spending their time fencing simply because they think it will help their college application, I find that to be a little bit silly.

Rebecca: I don’t think we would have found that billboard in my neighborhood. [LAUGHTER]

John K: Although if you brought a saber to work, [LAUGHTER] you might get more attention.

John F: That raises a host of other issues. [LAUGHTER]

Rebecca: In your study, you also examined admission rates at highly selective public colleges. Do their admissions also favor students from high-income households over lowincome households when other student characteristics are held constant?

John F: Yeah, so the public most selective institutions, they provide a really interesting contrast to the private schools, and there are really two differences. The first difference is that it’s still true that students from high-income families with the same test score are more likely to be attending these places like UC Berkeley or Michigan than students from lower-income families. But it’s not the super concentration in the top 1%, the top 1% are about 20% more likely to attend, but so are the top 5% And roughly top 10%. It’s more kind of a broad top of the income distribution than kid of the uber rich that are benefiting from this. Then second, when you do the decomposition that we do at the private schools, you find that, in fact, it’s not the admissions process, the chances of admission for students with a given test score are almost identical across the income distribution, if anything slightly higher for lower-income students. The big differences come in the fraction of students who apply to these schools. You see almost all of the over attendance is explained by higher application rates of high-income students. And so that really points to a very different part of pipeline. And I think there’s a whole other set of issues that in kind of policy concerns that that brings up, just to cite some fantastic work in this space by my colleague at Harvard, Sue Dynarski, she and a number of co-authors have worked with the University of Michigan over the past 10 years, on something called the Hail scholarship. And this program is really focused on this application phase where they reach out to students who are doing very well in Michigan Public Schools, and who are not from high-income families. And they not just inform the students about the University of Michigan, but they provide a simplified form of financial aid, that’s a tiny bit more generous, but just mostly clearer, that’s basically guaranteed zero for four years. And that seems to have really large effects, big increases in the share of students who are applying who receive these types of fliers, that then carries through to those that are admitted and those that end up matriculating. And so, first of all, it’s really interesting that there are sometimes different problems at these different schools. But also, I think it’s a nice lesson that even among two different schools, which are objectively at the very top of the U.S. higher educational sector, there are really important differences in terms of how these different institutions operate, and what types of policies are going to be most appropriate for increasing diversity of students and social mobility at those places.

John K: Is the rate of return to education significantly different between the Ivy plus institutions and elite public institutions?

John F: The answer is yes. But it’s different in a very particular way. So in our data, what we find, using a bunch of different empirical approaches, is that students that attend these Ivy plus institutions are significantly more likely to be at the very top of the income distribution to attend an elite graduate school, to hold a very prestigious job. They’re much more likely to do that than students who attend the very most selective of the public institutions. Those public institutions, in turn, are significantly better at propelling students to these leadership positions than lower rated less selective public institutions. And so it is both true that those public institutions are very good, and also true that these Ivy plus schools are really quite a bit better. That’s focusing on these top end leadership positions. If you look instead at something like what’s the chance that you’ll be in the top 20% of the income distribution, so for kids in their early 30s, that’s earning more than about $60,000. So that’s a good solid, professional job, you don’t have to be a hedge fund manager, there, attending these Ivy plus schools is not really going to make that much of a difference. And the reason is that at that point in the income distribution, that’s just not what the schools are designed for. You’re quite likely to get a job that’s going to pay more than that from an Ivy League school, you’re also quite likely to get a job that pays more from that at one of these elite public institutions. There are differences in average income, but it’s really driven by this kind of a lottery ticket that you’re getting on maybe you’re going to be really just an extreme leader, again, either very top of the income distribution, very prestigious firm. So the answer is yes, these schools differ, but they primarily differ in this particular way, which is why we’ve placed the emphasis on leadership rather than just kind of broad economic security. It’s not clear that students from Ivy plus schools are just broadly more economically secure in that middle of the income distribution than those from public schools.

John K: You also examine in this paper what would be the effects if the admission process at the more elite institutions were similar to that at highly selective public institutions? What do you find there in terms of the income diversity of students in the Ivy plus institutions if those preferences were eliminated?

John F: Yeah. So we’re able to simulate, exactly as you say, what would these classes look like at least probabilistically, if the admissions office were to place less weight on some of these factors, and it makes a meaningful difference. So just to give you one statistic, currently, on average, there are a bit less than 60% of students at these schools that come from the bottom 95% of the income distribution. Those are families making less than call it $250,000 A year. If you were to get rid of all these three preferences that I’ve talked about, if you were to remove preferences for legacy students, just to be clear on what that means, we’re just going to admit them based on all the other characteristics, oftentimes they’re great students, but we’re just not going to give them an extra boost for being a legacy student. If we were to remove this seeming bias that arises in the process where higher-income students are getting stronger non-academic ratings, and if you were to not necessarily remove athletics, but just make the athletes look like all the other students, so there’s not this tilt towards high-income students among athletes, you would increase the share of students from the bottom 95%, from a bit less than 60 up to about 70%, a bit less than 70. And so what does that mean in practice, again, there are about 1600, 1650 students in the average entering first-year class, we’re talking about another 150 to 160 students from more modest backgrounds. And, of course, this is not an enormous change. But it’s on the same order, as people are talking about when we think about what’s the difference in student bodies that might come from changes in racial preferences in admissions flowing from the Supreme Court decision. It’s on a similar magnitude. We’re gonna have 100, maybe 150, fewer students of color on campus. And I think it not only affects the diversity on campus, I think it also meaningfully affects the role that these schools are playing in upward mobility, particularly to these leadership positions. You make some admittedly heroic assumptions and kind of flow things through, this type of change is going to make another two or three US senators from the middle class instead of from very high-income backgrounds. And let’s not overstate this, like it’s only two or three senators, but for a set of decisions that literally 12 People can decide to make if they want to. I think that’s pretty impressive. And that doesn’t even think about well, what if the Northwesterns and the NYUs of the world decided to make some of these changes as well. So my sense is that we’re not going to remake society by doing this, but it’s a pretty low-hanging fruit. And the thing to say is it just from a policy perspective, you can achieve the same differences in the admissions pool, either by getting rid of the preferences that are afforded to high-income students, or by introducing new preferences that benefit students from low- and middle-income families that are particularly academically strong. And what we show in the paper, we kind of calibrated, we say like, if you were to introduce a new preference, specifically designed to get exactly the same mix of students that you would get from eliminating these preferences, what you would need is a preference for low- and middle-income students that’s is weaker than the preference even that current admissions offices put in place for legacy students. So legacy students, on average, are about three or four times more likely to be admitted, you’d need really strong academic students from low- and middle-income backgrounds to be, on average, about twice as likely to be admitted. And that would be a big change. But it’s not like these are changes that go well beyond the type of preferences that are already in place in the admissions process,

Rebecca: …and seemingly pretty actionable. [LAUGHTER]

John F: Yeah, and look, I think that this is a particular moment of fluidity in higher education admissions. Because of the Supreme Court decision, people are not just reconsidering how to think about diversity. That’s kind of the direct effect. But once you open up the gearbox, I think it then becomes natural to rethink a lot of different things when it comes to admissions, both because once there’s a process, it’s easier to think about other stuff. And also because I think that having a preference for students from overwhelmingly high-income families becomes increasingly awkward when you’re no longer allowed to give preferences for students who are clearly experiencing very large disparities in the run up to college. So I think almost all colleges are really strongly considering a bunch of this stuff. Some of them are doing so in publicly announced committees. Here at Brown University, I serve on a committee, including both faculty and trustees that are thinking about a bunch of these issues. Other universities are doing it more internally, only trustees, maybe it includes students. All the universities are doing this in a different set of ways. And I wouldn’t be surprised if we see more change in the way college admissions works over the next year or two than we’ve seen in a long time. And so yeah, hard to know what will happen, but these are an incredibly important set of issues to consider and I hope we’ve been able to contribute to that debate. As an academic, all you can ask for is that people will listen, policies, it’s up to them. There’s a lot of factors that go into that go beyond the research. But we’ve been really, both in public and had a lot of conversations with university leaders about how to think about these issues. So whatever the decision is, I’m confident it will be made on the basis of what I hope is a better set of analyses and understanding for what’s going on than we had before.

John K: Before, I think everyone expected that these types of results were occurring, but I don’t think it was really clear how large the magnitude was. And your study certainly contributes to that knowledge. Having data like this, and these results, I think, will put more pressure on institutions to change than just the general suspicion that they were privileging a very elite group of students. One of the things you note in the study is that making these changes will lead to a more diverse leadership pool, but it may not have as much of an effect on intergenerational income mobility. Could you talk a little bit about that?

John F: That’s exactly right. And I think that stems from some of the themes we’ve been talking about, where the role that these schools play in intergenerational mobility to leadership positions, that’s potentially very large. But they’re just too small to play a role in addressing some of the very broad differences in equality of opportunity that we see in this country, other than through kind of the indirect channel, which is that I think when you have individuals in these leadership positions that come from a broader range of backgrounds, you’re more likely to get policy that’s made in a way that takes into account some of these effects. And so that actually leads to some of the research that we’re really now focusing on, which is that, when you think about intergenerational mobility and higher education, an initial paper that I wrote on this, decomposed the problem into what we called access, that’s who’s attending and the success, what happens to the students that attend, you need both of them to be working together to have intergenerational mobility. If either of them is absent, then you have less mobility. And what we found was that different types of institutions seem to have problems in different areas. So institutions that were highly selective, not only the Ivy plus institutions, but honestly also some of the public institutions in the country, their lack of effect on mobility, in large part, was coming from the relatively un-diverse set of students on an income dimension that were attending their school. Many of these schools, again, both public and private, the share of students come from the bottom 20% of the income distribution is really just 3 or 4%. Really not large at all. So we really wanted to separate the question for these institutions of how do you improve mobility through increasing access with the situation for what is a very different set of institutions, not just the elite public institutions, but some of the open-access institutions, the community colleges where there, not that access can’t be improved, but I think much more the problem is that, in many cases, students are attending these institutions and not being propelled upwards in the income distribution in the way that we would hope. And so that’s really now what we’re focusing on: How can we first measure, in a very broad way, what these different institutions and programs are doing in order to propel students up the income ladder, to really give them the skills, the human capital, the social capital, in order to get good paying jobs and move upwards after that in their career? And then what are the policy levers that you would pull in order to improve that? The way I like to think about this is suppose that you gave the governor of California $10 billion to improve upward mobility in education in his state. Would you want to get more people going to Cal State instead of the California Community Colleges? Is it important that you not only go to all Cal State, is it important that you go to a particular Cal State? Is it important that you have a particular program? Are some programs much more effective than others? Should we be encouraging more people to go to community colleges, even if that costs and has fewer people going to Cal State? Do we want more people to start at community colleges and transfer up to Cal State? Do we want more people to not start at community colleges, because it’s better if you start directly at Cal State? There’s all these different questions. And there’s been some great research on different aspects of it, but I think with the data that we have, we’re hoping to provide a more unifying framework to think about what are the particular places where there’s more or less success for students, again, defined as like the causal effect of attending these places. And how can we expose more students to high success environments, either by moving them around or by changing what the programs are?

John K: In your intro, we mentioned that you were a member of the U.S. Treasury Council on Racial Equity, and the Co-Director of Opportunity Insights. Could you talk a little bit about what these organizations do?

John F: So Opportunity Insights is a research and policy organization that I run jointly with my co-authors Nathan Hendren and Raj Chetty. And what we’re doing there is trying to put together a research agenda to understand upward mobility, both from an academic and a policy perspective. Research that involves this kind of big data has evolved over the last decades to almost look more like a science lab where it’s very team oriented. It’s not a professor and her keyboard or chalkboard just kind of plugging away in isolation anymore. And Opportunity Insights is a way for us to organize all of that team in terms of there are other faculty that we collaborate with, there are graduate students we collaborate with, there are research assistants we collaborate with, there are visitors at all different levels that we collaborate with. And so Opportunity Insights is really the organization through which we just do a lot of this research and try to translate it to help policymakers and whatever that means, depending on the research. The Treasury Advisory Council on Racial Equity is very, very different. Treasury is one of the largest agencies in the federal government. And it has many different policies that directly or indirectly affect racial equity in ways that are obvious or not obvious. And the purpose of this Advisory Council is to bring together people from many different aspects of society that are relevant to Treasury’s financial policymaking. So there are a couple of academics on the committee like me, but there are also people who run financial institutions, there are people who run nonprofits that deal with financial institutions, people who run non-financial institutions, more businesses. And the idea is to be a group that can both proactively offer suggestions to Treasury in terms of how they can change things either out of blue sky or on particular policies that are undergoing after policymaking, as well as a resource for them to turn to when they say look like we’re trying to figure out… an example is a lot of the focus of Treasury over the last two years has been the implementation of the IRA bill, which includes a lot of tax incentives for green investment. How can they implement all of those tax credits? How can they write all those regulations in a way that really does so to support racial equity, and to make sure that black and Hispanic and native individuals are not left behind in a way that, unfortunately, has been too often the case in our nation’s history. So that’s far from a full-time role. We meet once a quarter in public meetings and try to offer our suggestions. And even again, this suggestions span how Treasury should implement different regulations from even how Treasury can make research on racial equity more accessible, or make data more accessible to support more research so that there’s more broad knowledge when it comes time for policymaking.

Rebecca: You’re doing some really exciting and interesting things.

John F: Thank you.

Rebecca: Thanks so much for your work and sharing it with us today. But we always wrap up by asking: “What’s next?”

John F: So I talked about some of the work in the college space. But I’m trying to think about other parts of upward mobility as well, to understand how environments or policies contribute to these disparities or what policies can help alleviate them. And a big theme in some of my recent work is to try to broaden our measure of mobility to go beyond these purely economic measures. It’s a natural place to start, both because having a higher income is something that is kind of meaningfully related to the quality of one’s life and also because it’s pretty consistent data to measure income. But I think even economists will admit to you that income is not the end of it. And we’re trying to think about other ways, not only to measure people’s wellbeing thinking about health, thinking about social capital, for instance, but also to measure or folks influence on broader society. So there are positions like entrepreneurs or scientists, inventors, that if we generate more innovation in society, that’s not something that just benefits the individual inventor, it’s something that benefits society much more broadly. And so I think that’s not only very important as kind of an alternative economic outcome, but it’s important to thinking about why something like social mobility goes beyond merely thinking about well, each individual should have their fair chance of success. These are ways in which just society as a whole is better, more innovative, more engaged, when there’s more upward mobility. And in that way, I think it’s really a rising tide that can lift all boats. So that’s a little bit of what I’ve been thinking about recently.

John K: Well, thank you for taking the time to join us. We really enjoyed this conversation. And we really, as Rebecca said, appreciate all the work that you’ve been doing.

John F: Thank you so much. It’s really been a pleasure to talk with you about all this work over the last hour and I appreciate that.

[MUSIC]

John K: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

323. Explore First Study Abroad Program

Compared to continuing-generation students, first-gen students experience a higher risk of not completing a college degree. In this episode, Sue Roberts, Marianne Young, and Beth Hanneman join us discuss a study-abroad program for first-gen students that is designed to build their confidence, sense of belonging, and help them understand the connection between their education and their career goals. Sue is the Associate Provost for Internationalization at the University of Kentucky. Marianne is the Assistant Vice President for Smart Campus Initiatives at the University of Kentucky. And Beth Hanneman is the Associate Director of Career Advising and Career Education, also at the University of Kentucky.

Show Notes

Transcript

John: Compared to continuing-generation students, first-gen students experience a higher risk of not completing a college degree. In this episode, we discuss a study abroad program for first-gen students that is designed to build their confidence, sense of belonging, and help them understand the connection between their education and their career goals.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are Sue Roberts, Marianne Young, and Beth Hanneman. Sue is the Associate Provost for Internationalization at the University of Kentucky. Marianne is the Assistant Vice President for Smart Campus Initiatives at the University of Kentucky. And Beth Hanneman is the Associate Director of Career Advising and Career Education, also at the University of Kentucky. Welcome, Sue, Marianne, and Beth.

Sue: Thank you, we’re glad to be here.

Rebecca: Today’s teas are:… Sue, are you drinking any tea?

Sue: I am not drinking tea right now. But if I were in my normal space, I would be drinking tea. Yes.

Rebecca: Do you have a favorite kind?

Sue: I do. It’s a rooibos tea, a red bush tea.

Rebecca: Wonderful. Marianme, how about you?

Marianne: I’m not currently drinking too, but I have one on the ready. It is a lovely wild sweet orange.

Rebecca: Nice. What about you Beth?

Beth: So I went to Montana this past summer for a yoga retreat and fell in love with Huckleberry. So I now drink a wild Huckleberry tea at least once a week. And that’s what I’m having this morning.

Rebecca: I have never had that. I think it’s a first on the podcast.

John: It is. I am drinking an Irish Breakfast tea.

Rebecca: And I have a Jasmine Dragon Pearl this morning.

John: Dragon pearls?

Rebecca: Dragon pearls. [LAUGHTER]

John: Ok, so we have a mythical tea. [LAUGHTER] We read about the Explore First Study Abroad program in an article in the Chronicle recently. And so we invited you here to talk about that. Could you give us an overview of this program?

Sue: Sure. It’s a new program for the University of Kentucky, run for the first time in summer 2023. We took 60 students, 60 undergraduate students, all of them first-generation students to either London or Dublin for a three- week Education Abroad program focused on career readiness.

Rebecca: Can you talk a little bit about this program came about?

Sue: It came about in many different ways, actually. There were conversations happening on our campus for probably two or three years before COVID, even, among different colleagues, some in the Career Center wondering how they could produce really good career readiness, education abroad programming. So I’m in the office of first-generation student success thinking about how we could do a better job in introducing first-generation students to education abroad. And then in the International Center, in the Education Abroad office itself, there were lots of conversations about how we could partner with colleagues across campus to develop programs that would reach this demographic.

John: One of the things we were really intrigued about was a program that was designed to benefit first-gen students as well as providing those career readiness skills. Could you describe a little bit how this program integrates that career focus?

Beth: Yeah, I’ll take that one. So over in the Career Center, we have the national association called NACE and they have NACE Competencies. And so when you start thinking about any major that a student has, you want them to make sure that they have those skill sets. So when they actually get into the workforce, they’re able to be analytical, they’re able to have communication skills. And what I love about the first-gen program and Explore fFrst within that, is the idea of how do you do that in a global setting. And so when you start thinking about designing this curriculum, and me and Marianne had the privilege of helping to work on that. It was this idea of, we had at least find out what the foundation is that the students had. And so sort of thinking about block scheduling, where a lot of times professors may say we’re going to do one topic and then go to another, I did more of what we call spiral curriculum, where you introduce a topic, and we brought it in here in the United States before we left, so maybe it was resumes where they had to create a resume and work on a resume ahead of time. And then when we’re overseas, we re-introduced resumes to say, “How would you put this Explore First experience on your actual resume? …kind of the same when it came to networking. What does it look like to navigate, to connect with people? Okay, great. We do that here in the United States. But then how do you do that in a global setting. So it was one of those things where you can actually see that reinforced. I also thought that was really cool when it came to interviewing as well, of having that prep for the students within that area.

Rebecca: We have a couple of other episodes of tea for teaching that also talk about the NACE competencies that we’ll link in our show notes for folks that are interested in that particular detail. So we just talked about NACE. Can you talk a little bit about the benefits that students get from it being a study abroad experience?

Beth: Yeah, at least for myself, the world is definitely interconnected. And so what I loved about how we interacted with employers is that we first looked at those that were connected here to Kentucky, and then we reached out with those that would be overseas. So for example, we have a company named Alltech that’s located here in Lexington. And so our students on the Dublin trip was able to actually go see their location. So it wasn’t one of those things that “Oh, hey, we’re just randomly seeing a company.” We’re very methodical about how that connection is. Another company, Compass, for example, does food services for our University of Kentucky health care system. So it wasn’t one of those things of just like, “Oh, we’re just gonna go see a company.” It was one of those elements of not only is making this connection abroad, but how does this actually impact me back home. And we would actually talk about that. Students would be like, “Alright, yes, you see this in another country, how does cultural awareness make a difference? How does being able to navigate and learn about yourself influence who you’re going to be back at UK?” And one of my favorite questions we asked in the interviews that they had to do for one of the assignments was: “If you’re back on the college campus, and you run into the university president, what are two things you tell them about the program?” And it was really cool to hear from the students that like, “I didn’t think I could learn so much about myself in three weeks, let alone three months about a career,” and others have never been on a plane before to navigate what that looks like. So even if you go into the job market, most likely somewhere along the line, you’re probably going to have to travel somewhere and do connections, but to have that support to have other people with them, when they did it for the first time was really impactful.

Rebecca: I love that reflection question. [LAUGHTER] So many benefits to that.

Marianne: I think the global stage also provides a really unique opportunity to just boost confidence with these students, as Beth was talking about, some of our students had never been on a plane. And not only did they navigate getting on a plane, they navigated getting into and past customs and immigration and all of that. And then the most surprising piece to me, in terms of what this looked like in terms of that confidence boost is at the beginning of our core sessions with the students, they put together kind of a: “these are what my goals are currently.” And by the end of the program, not only physically the confidence that you saw as they stood in front of the class, and they were presenting what their new goals were, for some of the students it expanded the opportunities that they were considering. They had never considered what it might be like to be in a leadership position in a global organization, or for the other students, it solidified what it was that they were wanting to do. And that confidence that they had of “Yes, I’m on the right path,” I think came from them navigating situations that they hadn’t been in before. And then being able to connect with different companies and different leadership individuals within the company, who they could see like, “Oh, my gosh, they were first generation as well, and now they’ve moved abroad, and they have this position in the company,” and the confidence that came from being able to navigate an international city as well as “I have confidence in how I’m going to navigate my career pathway,” that was so amazing to see in the sestudents.

Sue: I will agree with that. I visited, I think, three of the four programs. The program was split into four different groups, two went to Dublin two to London. So there were 15 students in each and I think I’ve visited three of them over the course of the summer, and to see that confidence grow, almost hourly, was incredible. And I will say that I think it translates, we’re hoping anyway, that it will translate, into greater understanding and kind of sense of purpose as a student. So you can see the point of your degree, you can see the point of why you’re struggling through this or that course to make it through to graduation. And of course, we want to see good results in terms of retention rates and graduation rates.

Rebecca: I’ve had the opportunity to teach a couple of travel courses where I’ve had students who had never traveled before, some within the US and some travel abroad. And I agree that seeing the confidence growth in students is such a rewarding experience for the instructors as well as for the students. It’s a really powerful experience. But one of the things that I really love that you’re describing is this connection to alumni, and those really specific intentional connections between the businesses locally as well as abroad. That’s a really beautiful component of your program.

John: And one of the challenges that all colleges face is the relatively high DFW rates generally experienced by first-gen students. And by making clear to the students the salience and the relevance of the material that they’re learning, and how this can open up these possibilities to them in a very obvious manner that they may not naturally see, I can imagine this could be really transformative.

Marianne: I think one of the great moments we had as we were visiting one of our employer partners, as Beth was talking about the spiral curriculum, he had talked about LinkedIn profiles and been helping them and then we get to this employer visit. And they start talking about LinkedIn profiles. And it is almost the exact lecture we had given that morning. And students are turning around and saying, “Oh, my gosh, you told us that this morning, and here’s this employer saying this exact same stuff. You were right.” And so we revisited again, and then the next employer, and so it was the aha moment of “Oh my gosh, this is actually something that I’m going to need and I’m going to use as I navigate my career.”

Rebecca: Can you talk a little bit about what a typical day for a student looks like in this program.

Marianne: There was no typical day, but this will kind of give you some activities they may have been shuffled around a bit. We’d start off with maybe some class time reviewing the visit. Maybe we’d have the day before talking about the experiences that the students had, answering any questions they may have had, how they navigated a challenge, just really taking time to connect and then help them build on the information that we were presenting. Once we kind of move through class time, we might have visited an employer in the afternoon and done a site visit where we not only learned about the company but also some of our employers took us through exercises like design thinking at some of our tech companies, or walking us through interviews and resume reviews in terms of a mock opportunity if you’re applying to their company. And then we may also have a cultural visit in the afternoon, visiting a significant landmark in the area or learning about the history and the culture of the particular space that the students were in. And then in the evenings, our students would maybe get together and cook in the residence hall, or they might go out to dinner together. And so generally we had class time and some cultural visits or an employer visit.

Beth: Yeah, exactly what Marianne said, and when you think about over the three weeks, because we were there for three weeks with these students, the beginning part of the classes were more kind of prep and foundation to get them to know what to expect. And so we broke teams of three, and so we would have one person would be the person who was in charge of introducing the group, we had one person that was the photographer, one person that was in charge of the “Thank you” at the end for each site visit. And that was really cool to see him learn collaboration, but also kind of change up and like, “Oh, well, this person is really interested in architecture, so we’re gonna have him be the speaker for this one, and then I’ll do the photography. And this one over here, we as a group, we actually wrote the thank you note together of what that means to follow up within it, kind of expectations within it.” So that was really cool in terms of curriculum, and kind of how we set that beginning. And then closer to the end like Marianne said, was more like review: “What did you learn from it and reflection?”

John: Do students travel with faculty or staff from the University of Kentucky?

Sue: We structured this program so that each group of students was accompanied and led by two professional staff members from the campus. Typically, it was a person from the Career Center, and a person from the Office of First-Generation Student Support. So it gave the students oftentimes very familiar people who understood where they’re coming from, and the skills they brought to the table, but also a person with the career advice ready for them kind of as needed. So it worked really well, I think, to have those program leaders on the ground with the students. And we weren’t hosted by a university, although we did visit universities in both locations. But we worked with a education abroad partner provider called AIFS. And they have provided the classrooms, they assisted us find student accommodation, and they worked on us with the cultural visits.

Rebecca: I think I remember also reading that you did some work prior to going abroad and some coursework there. Can you talk a little bit about what that looked like?

Marianne: We had an opportunity and clusters with the students, we broke them into smaller groups to help prepare them for what to expect as they were preparing for their education abroad experience. And so we covered a variety of topics of what about your luggage? What is a carry on? What is it checked bag? How do you move through security? What can you expect in an airport? What can you expect in terms of customs and immigration? We talked about how to prepare for the weather, how to think about budgeting, and being prepared for different costs of things, or how you might be able to consider all of the different pieces and parts of preparing for souvenirs that you want to get… all those different things, a variety of cluster topics to make sure that our students not only had a connection with the person that they were going to be traveling with, but also the other students. And then it gave us space for any of the questions that students may have had, as they were preparing for this experience.

Beth: It’s just a great way, because a lot of times when I’ve done education abroad, you might meet at the airport for the first time. But what I loved about this program is that we literally got to know each other prior, to at least kind of understand maybe some of the things that they were concerned about as a student. And so then as a staff member, we can be like, “Okay, let me give you some extra resources.” I remember one particular student, I ended up calling her mom and her was on the phone, because she’s like, “Okay, Beth, I know you went through the whole situation of what we need to do for the airport, but my mom has questions.” And I was like, “Sure, no problem. Let’s talk.” And so her mom was like, “Oh, nice to meet you Beth. Her mom dropped her off at the airport, gave me the biggest hug. When her mom picked us up. She was like giving everybody in the group a hug, because we were extended family for them for three weeks.

Rebecca: Can you talk a little bit about the timing of the program?

Sue: So last year, it was the first time through, so I think we had to do things very quickly. We had to assemble a team, we had to get these clusters stood up. We had to recruit students, we had to find the scholarships for them and all the rest of it in kind of a hurry. So this year, we’re spacing it out a bit more. So we’re recruiting for summer 24 right now. And we’re going to repeat the program, we’re going to take 30 students in two groups to London and 30 to Dublin in two groups. So we’re excited about that. And then their travel occurs during the summer vacation, early in the summer vacation, so May and June this year.

Marianne: The interesting piece of the timing as well was I was on the first group that went to Dublin, and we were actually able to connect with the group that was coming after us in the airport as they were preparing to go out, so my students were able to pass along some words of wisdom and some thoughts to the group that was coming after them. And so that was a really fun piece with the timing to be able to catch up with each other in the airport.

Beth: In terms of curriculum, the way it was set up, there was one class that everybody was part of. So we actually met as a group virtually, with all 60 students ahead time. So everyone had that basic foundation. And then when we’re actually over there, that was when we did the actual classes for the individual pieces. So I did Dublin two and London one. And so at the same time, we’re having curriculum in terms of giving feedback for the next group coming over.

John: Now, you mentioned that there was some time spent acquiring funding, could you talk a little bit about the funding that was used for this program?

Sue: Sure. And this is a little unusual, I think. It was a surprise to us when the Kentucky State legislature or general assembly awarded some funding to all Kentucky institutions of higher education to support displaced students, so refugee students primarily. As part of that program, they allocated a certain amount of funding also to support education abroad and exchanges. So when we realized that, which was only in the summer before, so summer 22, we thought, “Aha, we could finally make this happen. This thing we’ve all been talking about in different ways about connecting careers, connecting first-generation students with education abroad, and making a real difference for those students, and we could do it at a actually a quite a big scale for education abroad, 60 students is quite significant.” So we seized the opportunity. The trick, then, of course, was to find matching money, because it didn’t cover everything. So we found some money internally at the university, we used education abroad scholarships, our administration at the very highest levels awarded us some funding to kind of back us up if we needed it. So it was a team effort. And this upcoming year, we don’t have the state money. That was a one time deal, so we’re funding it all from our university funds.

Rebecca: So cost is always a concern, I think, for first-gen students, and may be one of the reasons why they don’t even think they might ever go abroad. I know that was the case for me, as a student. I didn’t think I was ever going to get a chance to go abroad, but I got to when I was in graduate school. So can you talk a little bit about what this meant to the first-gen students or if you had trouble initially even getting them to think that they could really actually participate in this program?

Beth: Yes, one of our students on Dublin two got the email about applying and that the program was going to be there when we started doing the recruitment. And he was like, “Is this a scam? Is this true?” We went over to the first-gen office to verify because he’s like, “it sounded too good to be true.” And so once we got the word out that it was, of course, students applied and said, “Okay, let’s do this.”

Sue: You’re absolutely right that it’s the number one barrier of first-generation students is finances. And I think it was the majority of our students on this program are Pell recipients. So first-gen is a very big category. But we did try and make a difference, particularly for students whose financial means were limited. So it was a tremendous opportunity for them. And as Beth said, some of them were very disbelieving at first of the opportunity, they couldn’t understand how this was happening, because they hadn’t thought that this was something that they could ever achieve. And that was another reason why we kept it to three weeks, because many of these students… well, in fact, I would say all of them… were working during the summer. So three weeks away from your summer job and earning is a big deal, and others had family obligations as caregivers, and so on. So that’s the reason why we ended up with a three-week timeframe was partly to be sensitive to those needs. And then in terms of the financing, London is an expensive city, and Dublin is an expensive city. And these are young people, these are primarily first- and second-year university undergraduates. So budgeting to shop, to eat, to go out is difficult, and especially when it’s a different currency and options are different, and the prices are different. So that was a big element that we’ve reflected on since this first time through, and I think we’ll be maybe just a little bit more supportive. We were supportive, but maybe just a little bit more supportive of how to budget when overseas because they were responsible for their own spending money on this program.

Rebecca: What about things like food or other personal costs for travel, was that included in the program?

Sue: So there were a few meals included. There were a few like welcome dinners and things like that included, but by and large students were responsible for their own catering as it were for their own food. And it turned out that was kind of an issue because it takes a bit of knowledge of the stores and what’s available and what’s affordable. It takes a bit of knowledge of how to cook in a budget conscious way and not just grab the processed thing. And of course these supermarkets are unfamiliar and I would say one thing we did think a lot about upon return and when we debriefed this was giving the students a bit more time to adjust to that situation and to learn their options and to cook because sometimes we were so busy with all these things we were doing every day that they didn’t have much time to plan their suppers, or to go shopping and cook so I’ll let Beth and Marianne chime in because they were on the ground, they know more, but that was the kind of impression I got.

Marianne: So, we had some bargain shoppers in my group that found meal deals at like close Tescos, things like that. And so it was always kind of a competition of “Did you know that the sandwich was included in the meal deal?” And so it was a pretty inexpensive breakfast and lunch and sometimes dinner opportunity for students that became somewhat of a game, to figure out, like, what are you going to put in your meal deal this time? And so a lot of our students were supportive in terms of sharing different deals that restaurants were doing. Did you know that on Tuesday, they have a student special where you can get this, this, and this. And so they were really great about sharing some of the tips and tricks and things that they picked up along the way. And then also sharing meals. So going to the grocery, and he brought me to purchase something, while I may not eat this whole thing, but if you split it with me, then I’ll get the next one. And so they were really great, that was really fun to see them kind of helping and sharing deals that they found along the way.

Beth: And one of the things that we did is we actually offered a time if someone wanted to come with me to the grocery store. We did a local one so they could see how close something was if they by chance needed something quick to eat. But then we actually went with them, which was one was a little bit farther away have more of the discount kind of larger what they would think of a supermarket type of thing here in the United States, just because, over there, you kind of buy more what you need, versus “I’m going to have lots in the refrigerator and freezer within it.” And we actually had a couple of times where we had meals together because it was someone’s birthday and we wanted to celebrate. And very similar to what Marianne said that they would be like, “here’s a deal,” or “hey, I’m going to make soup anybody else want?” And we had one student who loved to cook, and others are like, hey, awesome, I will help clean up, or pitch in for some money if you would be willing to be the person that actually wanted to make the meal, and they actually collaborated teamwork that way too. So it was really cool to see.

Beth: One thing I wanted to share is the fact I think people think that education abroad is three weeks, and then you’re done. For us, this is a lifetime connection for these students. So we actually had dinner with both groups separately, so they could get together and meet each other and see each other, I’ll get messages being like “Guess who I saw on campus?” and they have a competition of how many times they see a certain student, be like “I saw them three times this week, Beth, I saw this one four,” but even moreso is this confidence coming back to have to go after the dreams that they want. We had a student who, I’ll be very honest, had a really rough home life and had a lot of confidence issues and got over there had a chance to start talking, had a really good conversation with a couple employers. And we did a networking night where we invited all the employers back and they could come and network with the students. And she had a really good conversation with some of our staff that we actually had come over from UK to kind of see the program as well. And she followed up, wrote a note back to say thank you for this conversation, I appreciate it. This is what I’m looking for in terms of career or job, and that person connected her with to somebody back here in Lexington, she then goes and reached out to that person, met with them, interviewed, and now has an IT position that she never thought possible a year ago. So that’s really cool to actually see them do this steps, it’s one thing for us to say go do, it’s another for them to actually gain the confidence to go and actually obtain it.

Rebecca: What a great story.

John: One of the things that I think you’ve all mentioned is that this creates a really tight bond among the students as well as the connections to the staff members they traveled with. And that sense of belonging has been shown in a lot of studies to be a major factor in student retention. And I think programs like this can create really strong bonds that can help students be more likely to succeed.

Sue: I will agree with that. There were two young women on one of the programs who became fast friends. And I assumed they had been friends forever, and I just was chatting with them, and I said, “You know, you must have known each other a long time.” They said “no, we just met.” And one of them said that she was so excited to come back to UK in the fall… so this semester… and I said “well, weren’t you excited anyway?” And she said, No, she wasn’t, that her freshman year had been a little lonely, and she had not made a good connection with her roommate and was struggling a little bit to fit in. And she said “Now I have a best friend on campus, and we’re gonna have fun the next few years together. And I thought that was awesome.

Marianne: And I’ll brag on our students. They were phenomenal. I mean, when I told people that I was going to go to a foreign country with 15 college students, and we were going to travel the city and we were going to do all of the things they looked at me like, “Why would you take college students to an international city?” They were fantastic. They were supportive. They were curious. They were beyond what you could even imagine in terms of the questions that they were asking and the way that they engaged with the curriculum. We have phenomenal students here at the University of Kentucky and I was lucky to get to take 15 and I have them running across campus yelling my name saying “Oh my gosh, this is the first time that I’ve seen you since you’ve been back on campus” or seeing each other on campus is such an honor to be a part of just that family that we now have. And, like I said, they were the best students you could ever imagine traveling with. I do it again in a heartbeat.

Sue: So one thing that really impressed me about these students, actually taught me a lot about this category “first-generation” which is kind of thrown around is that these students are really amazing. I mean to get to the University of Kentucky, to be studying their majors, to be making good academic progress is an accomplishment for these students and they have the resilience, they have the resourcefulness, they have the curiosity, as Marianne said, to make the most out of education abroad. So these are not students who took this for granted. When they were in London or Dublin, their eyes and ears were open all the time. And they were busy taking it all in, reflecting on it, and they absolutely were some of the very best students I’ve ever seen on an education abroad program.

Rebecca: So do you have plans to evaluate the success of this program?

Sue: So yes, we built assessment into this program from the beginning. So we had a researcher from the College of Education who helped us and administered pre- and then during, and then post-surveys of each student. So she collected information about their responses and reflections to the assignments and to their learning, and also something about their intercultural learning as it were. So we’re going to also track these students and see how they do compared to the peers who didn’t get the opportunity to study abroad in terms of their academic progress and their graduation.

John: Excellent. We look forward to hearing more about how well this program works. We always end by asking, what’s next?

Sue: Well, we want to do this again. [LAUGHTER] So we think it’s working. We’ve got good results so far, assuming that the next summer is also successful. We hope to just keep tweaking it, making it better and better for the students and maybe building it in as kind of a signature program for first-generation students here at the University of Kentucky.

Rebecca: An incredible thing to invest in and offer first-gen students. Thanks so much for sharing the details of your program.

Sue: Thank you for having us. And thanks for your interest in this endeavor.

John: It sounds like a wonderful program.

Sue: Yeah, it’s been a blast to develop and to be part of I must say. It’s been fantastic. And I don’t think we mentioned but perhaps we should that over one quarter of our undergraduate students identify as first generation. So this is a significant population at our university which serves students of all sorts from the state of Kentucky and outside.

John: Excellent.

Sue: Thank you both.

Marianne: Thank you all

John: Thank you for taking the time to join us and to share this wonderful program.

Sue: Yeah, appreciate it.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

316. Help-Seeking Behavior

Continuing-generation college students are often better prepared by their family and peer networks for academic success than first-gen students with more limited support networks. In this episode, Elizabeth Canning and Makita White join us to discuss their research on differences in academic and non-academic help-seeking behaviors between first-gen and continuing generation students.

Makita is a graduate student in Washington State University’s Experimental Psychology Program. Elizabeth Canning is an Assistant Professor in the Psychology Department at WSU.

Show Notes

Transcript

John: Continuing-generation college students are often better prepared by their family and peer networks for academic success than first-gen students with more limited support networks. In this episode, we discuss differences in academic and non-academic help-seeking behaviors between first-gen and continuing generation students.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Elizabeth Canning and Makita White. Makita is a graduate student in Washington State University’s Experimental Psychology Program. Elizabeth Canning is an Assistant Professor in the Psychology Department at WSU. Welcome, Makita and welcome back, Elizabeth.

Elizabeth: Thanks for having us.

Makita: Hello.

John: Our teas today are:… Elizabeth, are you drinking tea?

Elizabeth: I am drinking coffee this morning. It’s morning over here in the Pacific coast.

Rebecca: How about you Makita?

Makita: I have a hibiscus berry tea. I don’t usually drink tea, but I got some just for you guys.

Rebecca: Awesome. [LAUGHTER]

Rebecca: Sounds like a nice treat. I have some chai today. John?

John: And I have an English breakfast tea today, because I got a long band practice tonight. [LAUGHTER] So, a little more caffeine will help.

Rebecca: [LAUGHTER] So we invited you here today to discuss your recent study entitled “Examining Active Help-Seeking Behavior in First-Generation College Students,” which was published in Social Psychology of Education. Can you tell us a little bit about how this study came about?

Makita: Well, for me, this was actually my master’s thesis. When I became a researcher, part of my dream is to change the world, make a difference, and I’m really passionate about people getting access to the things that they need. So when I was in undergrad, and I was exposed to a lot of first-generation college students, and when I was hearing my parents talk about their experiences as first-generation college students, I started to notice that things were a little different when you didn’t have people around you who could tell you about what college was supposed to be like. And then when I started reading the literature on first-generation college students, and I saw how, in my opinion, excessively large, the gap was between first-generation and continuing-generation college students. That really captured my attention. So then, when I went to a school, where they have a really high population of first-generation college students, it felt really appropriate to look at first-generation college students. And also I’m honestly really interested in help-seeking behaviors. You probably have experienced yourselves where you see one person who is very persistent and active in getting someone’s attention, basically, very annoying, consistently waving their hand… [LAUGHTER] …trying to come up and get someone to basically give them whatever they need or they want, versus another person who maybe is a lot more quiet and sitting there hoping that someone will help them. And I wanted to know why. What makes one person act so differently from another? So I was really interested in first gens and help seeking. And then, at the same time, Elizabeth had recently been to a conference where they talked about first-gen forward initiatives, which is where colleges encourage faculty and instructors to self identify if they themselves were first-generation college students, to encourage other first-generation college students at the university to feel more comfortable, maybe talking to them or going to office hours, things like that. And we combined those two things together into this study, where we could look at help seeking in first-generation college students and a shared identity to try to see if that would change how help seeking looked.

John: And you mentioned some of the gaps that are observed. Could you talk a little bit about some of the equity gaps between first-generation students and continuing-generation students in terms of their academic performance and success?

Makita: Yeah, so for first-generation college students, we tend to see that on average, they earn lower grades, and they’re more likely to drop out of college. And they’re also less likely to engage in academic success behaviors, like going to office hours, or trying to talk to their instructors after class, things like that. And there are a lot of different reasons for that. They quite honestly don’t have someone at home who can teach them those implicit unspoken rules about college, about what’s expected of you and how you should behave. So they have to learn that on their own and that can take a little extra time, which is pretty valuable when you’re in college, that time. And then, a lot of the time, when you’re a first gen, you’re also coming from a lower income family, which may require you to work while you’re also going to taking classes and it means that you’re a little less likely to live on campus, which can influence you in all kinds of fun ways. But, we were, as I said before, really interested in whether or not there was a difference in the type of help-seeking strategies that students were using and how frequently they were help seeking. We wanted to see if that was maybe part of the reason for this gap.

Elizabeth: Yeah, I’ll just jump in too, that one of the big inspirations I think, for this work came from a sociologist, actually. Her name is Jessica Calarco. I think she’s at the University of Wisconsi- Madison now, but she wrote a fantastic book, it’s called Negotiating Opportunities. And she did a lot of field work with children, looking at at how children from lower- or upper-middle class families act differently in the classroom and how children approach their teachers or how they seek out resources and things. And she found that more low-income students are much more passive in their health seeking behaviors than upper-middle-class students. And so we had kind of read this work and thought it was really interesting and wanted to see if the same was true at the college level, and how that might look with those types of behaviors in a college setting. So we wanted to see if that gap that they found with children was the same for higher ed.

Rebecca: Can you talk a little bit about the methods of your study?

Makita: Yes, so this was a little complicated. But I’ll try to go through it in the most straightforward way I can.

Elizabeth: I will say for a first-year Master’s student, this was about the most difficult kind of laboratory experiment to design for, like right off the bat. But Makita did such a great job. And I think it turned out so well. But the complexities of it actually make it super interesting. So hopefully, we can explain it in a way that is easy to understand.

Makita: So we designed this study when COVID was in full swing, and we were in lockdown and, as a result, the entire study is set up to be conducted through Zoom. So the way it would work was a participant would join a Zoom room, where they would interact with one of our many undergraduate research assistants. And the research assistant would introduce themselves as a lead experimenter, and they would give the participant a phone number and an email, maybe like, “in case we’re disconnected or something goes wrong, you can reach out to me.” And then they’d give this participant 10 questions GRE style math test, and they would have 10 minutes to take it. And immediately after they finish taking this math test, the research assistant would have a short, partially scripted conversation with the participant, they would say things like, “Oh, don’t worry if you didn’t do that well. I didn’t do that well, the first time I took a GRE test, I didn’t even know I was supposed to take it until like right before I took it, I did really bad. But I did way better the second time I took it.” And then in the middle of that partially scripted blurb, they would, in one condition, say “I’m the first in my family to go to college, so nobody at home knew anything about graduate school.” And that was our main intervention. So for half of the students, they heard the research assistant was the first in their family to go to college, and for the other half, they didn’t. So immediately after that, they’re given another survey. And in that survey, they are told, “Hey, you’re going to take another math test after this one. And if you can improve your score by about 20%, or by about two questions, then you will be entered into a raffle to win a $20 gift card.” So we’re incentivizing them to want to do better. And then the survey says, “Do you want to go over your answers from exam one?” If you say yes, then the survey instructs the participant to reach out to their experimenter or this research assistant so they can do so; if the participant says no, then the survey instructs them to reach out to the research assistant to get the link to test number two. So in both cases, this participant has been instructed to reach out to the research assistant to get their attention so that they can move on to the next step. But in one case, they are getting academic help, they are going over their questions from exam one. And in the other case, they are just getting the link to exam two. The thing that makes this study fun is that the experimenter isn’t going to answer, the experimenter is going to leave their Zoom camera black, ostensibly off, while they are potentially off doing something else, or distracted, or maybe something’s gone wrong, and they are disconnected, who knows? And they’re going to ignore any attempt to get their attention for about eight minutes. And during that time, what they did was they recorded any attempt to get their attention. We were looking specifically for any additional behavior outside of the Zoom room, something active and persistent added on to that, like calling us or emailing us or texting us, using that information that was provided to them at the very beginning of the session. So after that eight minutes had past, the researcher would come back and say “Oh my gosh, I’m so sorry, something went wrong with my computer,” and then they would either help the student go over some answers or give them the link to the next test. And then the student eventually took the final survey with some demographics and final questions in it.

Elizabeth: So it’s a pretty lengthy paradigm. I think our research assistants had so much fun doing this study.

Makita: They really did.

Elizabeth: They had a lot of acting training to make it believable. But in terms of designing it, in a laboratory experiment, you have to kind of make some trade offs with making everything standardized, but also making it at least somewhat realistic to what might happen in the real world. So we were kind of playing off the idea of being an instructor and having a syllabus where you have lots of information about how to contact the instructor. And we have exams all the time, as instructors in our courses. And so it might be the case that they would need to go over the questions that they missed for the first exam before the second exam. And so we were trying to kind of mimic that type of setting in this one-hour laboratory study. But again, this is a sort of a different experience, where you’re not really getting graded, and it’s not going to affect your GPA. So we had to add a little bit in there around incentivizing them to want to do well in this sort of hypothetical situation. But again, I think our research assistants had a great time collecting these data.

John: What did you find in terms of the differences in help-seeking behavior between first-gen and continuing-generation students?

Makita: So we had a couple of different measures of help seeking in this study. The first measure was whether or not the student wanted to go over their answers. And we found that regardless of condition, so regardless of whether or not the experimenter self-identified as a first-generation college student, first gens overall sought less help than continuing-generation college students, which lined up with what we saw in previous studies. Things got a little more interesting when we started looking at the active help seeking behavior. So students who said, “Yes, I want to go over my answers,” we categorized as academic help seekers and students who said, “No, I don’t want to go over my answers,” we categorized as non-academic help seekers. Then, if students used some kind of additional method of help seeking during that eight-minute waiting period when the experimenter wasn’t responding, they were categorized as active help seekers. So we had active academic help seekers and active non-academic help seekers. And what we found was that students, our academic help seekers, weren’t really impacted by the identity of the experimenter, but our non-academic help seekers were. So in our control condition, when first-gen students were seeking non-academic help, about 13% of them used active help seeking, but in our intervention condition, it was more like 43%. So that was a really big jump, and it was really cool to see that. In other words, when first-generation college students had a help provider available, who was also a first-generation college student, they were more likely to reach out to them in this active persistent way on top of sending a message in the Zoom chat, they were also emailing or texting or calling. When the research assistant identified themselves as a first-generation college student that made our first-generation participants feel more comfortable with reaching out to them in this non-academic realm.

Rebecca: So when we think about this study, what are the implications as we talk to educators or higher ed leaders and actions we might take or ways that we might think about it?

Makita: It’s always difficult to try to generalize from a laboratory study to the field or to real life. In this case, because the person who was performing the role of the help provider was a peer, most things that we can generalize this too would also involve peers. So for instance, if we have a upperclassman teaching assistant for a really difficult math class, maybe if that person self-identifies as being first generation that might make first-generation college students in that class feel more comfortable with asking for help in regards to, say working Canvas or Blackboard or accessing their homework or figuring out how to get the right textbook, things like that. Based on these results, we wouldn’t expect it to necessarily help with their academic performance. But overall, engaging in this type of help over time, might.

Elizabeth: Yeah, I would just add that it kind of highlights two nuances of help seeking that we’ve kind of overlooked in the literature so far. There is a lot of evidence that suggests that first-generation college students seek help less often than continuing-generation students. But not a whole lot of people are talking about the types of help seeking. So, there’s passive type of help seeking versus active type of help seeking. So, differentiating that might be really helpful and understanding where we might need to intervene and help these students. And then what we’re seeing in this study is that we also might need to break it down into the type of assistance that the students are seeking. I think a lot of times, we’re just assuming that they’re seeking help for academic reasons, like I don’t understand this content, explain it in a different way, or related to the content of a class. And what we’re seeing here is that we might actually need to break this down into what’s related to the course content and what’s related to more of this sort of navigational type of awareness that first-generation students might not have the background knowledge to address. And so this non-academic help-seeking behavior might really benefit first-generation college students. And there’s a number of different scenarios in which that might be helpful. So applying for scholarships and financial aid, navigating course seeking and course maps, and figuring out the requirements for different degree programs, applying to graduate school, applying to different research opportunities. All of those things are academic-adjacent, but they’re not academic in the sense of the course material that they’re learning in that course. So it might be the case that all of these other types of help-seeking behaviors, it might be important to intervene in those areas to help first-generation college students.

Makita: And something really interesting about this study is that if we hadn’t separated help seeking into academic and non-academic, we wouldn’t see the difference that we found, if we had just examined it as basic help seeking without separating it, then the nuance of this situation would be lost. And as Elizabeth said, in many of the studies that we read, and that we looked at, they look at help seeking as this just basic block, they’re not separating it out into active or passive or academic or non-academic. And it seems like that actually might be really important because how well an intervention is working for a different type of help seeking might be something that we actually didn’t notice in some of these previous studies.

John: And there’s been a lot of studies recently indicating the importance of providing students with more structure, particularly first-gen students, which might help students get past that barrier. But there’s also been a lot of studies that have investigated the effect of a sense of belonging and comfort in the institution. And having that peer connection to someone else with a similar identity as a first-gen student can help break down some of those barriers and help them overcome that, so that they’ll be more comfortable seeking help in the future, I would suspect.

Elizabeth: Yeah, absolutely. I think anytime an instructor can talk about their personal experiences, overcoming challenges that they have gone through, I think first-generation identity is something that is not as visible as other types of identities. And so that might be something that we need to provide to students if we feel comfortable doing so and talking about that in a way that might relate to students and that belonging, right, making them feel like you can have the same types of success, the same types of career plans, the same types of goals in college, as other students, no matter what your background is.

Rebecca: I think it’s interesting for instructors to just think about taking the time to be explicit about that. It’s an identity that you might take for granted or not think about exposing, but it might be worth planning to expose that really early on in the semester to see how that might benefit students.

Elizabeth: Absolutely.

John: One thing we did on our campus last year was we had a committee that was looking at challenges for first-gen students. And one of the things they did was they created some images that could be used in your signature line indicating that you were a first-gen student. And they distributed that pretty widely. And a lot of faculty and staff members have included that to help form those types of connections. It sounds like, based on your research, can be fairly important.

Elizabeth: Yeah, I think it’s a great initiative. I think here on our campus, we have some stickers and some like door hangers that you can put on your office door and things like that. But I like the email signatures a lot, because that kind of gets blasted to everyone. But yeah, I don’t think it can hurt. I mean, it’s a pretty simple type of thing that you can do. There’s not any evidence that it would be negative for anyone, at least at this point. So it’s sort of like a no-cost way of helping potentially a few students along the way. So yeah, I think it’s a great practice.

Rebecca: Are there follow up studies that this is making you kind of itch to do?

Makita: Oh, yes, definitely. For me, the ideal next step would be to try it in a real classroom, have either an instructor, or a TA for a lab, self identify as first gen to half of the class and not self ID the other and then see if help seeking changes. It would be really, really cool if we could do another behavioral measure of help seeking instead of just self report, but it gets a little complicated when you try to figure out how to track whether or not someone is emailing the TA or the instructor without accidentally infringing on someone’s privacy. So we still have a lot to go when it comes to actually figuring out how to run a study like that. But that would be my ideal.

Elizabeth: Yeah, I think one of the things that we really need is a really good measure of help seeking, whether it’s self report, or whether it’s a way to assess that in some kind of behavioral data. Right now, there’s several different help-seeking skills out there where students respond to them. But they’re not as nuanced as what we’re seeing here around this academic versus not, this passive versus active. So a measure where we could really look at that nuance, I think, would help the field in general in terms of looking at whether interventions are increasing help seeking in various ways. And then of course, the behavioral measure is really, really interesting to us in terms of what students are actually doing. And we’re still kind of figuring out what that might look like, is that something that we can pull from, like their website data. So how often students are looking in the LMS for certain material, how often they’re clicking on things, whether or not they’re going to tutoring centers and office hours and things like that. So we’re still trying to figure out how to measure the behavioral side. But at the very least, we definitely need a really strong self-report measure of help seeking to move this research along.

John: We always end with the question, what’s next?

Makita: What’s next is I’m going to go back on campus and teach an introductory psychology class.

Elizabeth: Great. Next for me is I have meetings all day. [LAUGHTER], but I’m looking forward to the weekend. Actually, something that’s exciting for me is next week I’m going to a conference in Indiana that’s bringing together a bunch of educators looking to build up infrastructure for conducting research in education. So we’re going to be talking about barriers to doing types of different research in education and how we might solve those in the future. So I’m excited for that. I think it will be a great brainstorming opportunity to figure out how to make this type of research easier to conduct in different educational settings.

Rebecca: That sounds awesome. I hope that you’ll share back what you’ve learned and decided. [LAUGHTER]

Elizabeth: Yes, that’s the plan.

John: Well, thank you. It’s always great talking to you, Elizabeth, and it’s really nice meeting you Makita, and I hope we’ll be able to talk to both of you in the future.

Elizabeth: Great. Thank you so much for having us.

Makita: Thank you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

Ganesh: Editing assistance by Ganesh.

[MUSIC]

303. Higher Ed Then and Now

Teaching practices have gradually evolved as we’ve learned more about how humans learn. From one year to the next, these changes may appear small, but the cumulative effect is profound. In this episode, Todd Zakrajsek joins us to reflect back on the changes that have occurred in higher ed during our careers.

Todd is an Associate Research Professor and Associate Director of a Faculty Development Fellowship at the University of North Carolina at Chapel Hill. He is also the director of four Lilly conferences on evidence-based teaching and learning. Todd is the author of many superb books, and has published four books in the past four years. His most recent book is a fifth edition of Teaching at it’s Best, a book he co-authored with Linda Nilson.

Show Notes

  • Zakrajsek, T. and Nilson, L. B. (2023). Teaching at its best: A research-based resource for college instructors. 5th edition. Jossey-Bass.
  • Zakrajsek, T. D. (2022). The new science of learning: how to learn in harmony with your brain. Routledge.
  • Harrington, C., Bowen, J. A., & Zakrajsek, T. D. (2017). Dynamic lecturing: Research-based strategies to enhance lecture effectiveness. Routledge.
  • EdPuzzle
  • PlayPosit
  • ChatGPT
  • Wayback Machine

Transcript

John: Teaching practices have gradually evolved as we’ve learned more about how humans learn. From one year to the next, these changes may appear small, but the cumulative effect is profound. In this episode, we reflect back on the changes that have occurred in higher ed during our careers.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guest today is Todd Zakrajsek, and I am with Todd here in Durham, North Carolina. Todd is an Associate Research Professor and Associate Director of a Faculty Development Fellowship at the University of North Carolina at Chapel Hill. He is also the director of four Lilly conferences on evidence-based teaching and learning. Todd is the author of many superb books, and has published four books in the past four years. His most recent book is a fifth edition of Teaching at it’s Best, a book he co-authored with Linda Nilson. Welcome back, Todd.

Todd: Well, thank you, John. Well, this is exciting. And Rebecca may be a long ways away, but I have never been arm’s length from a person who interviewed me for a podcast before.

Rebecca: Isn’t that cool?

John: And we’ve really done that before either at a conference or at Oswego,

Todd: I feel very special.

Rebecca: Well, we can celebrate with our teas. So, today’s teas are:… [LAUGHTER]

Todd: I’m drinking a peach mango that I got from some teas that John brought, which are fantastic.

Rebecca: John, how about you?

John: I am drinking a Tea Forte black currant tea, which I brought from Oswego, in a new mug that was given to me by Claire McNally, when she visited this area last week.

Todd: Love Claire, she’s fantastic.

John: And it has kangaroos on it.

Todd: Yeah.

Rebecca: And I can’t see it. Let me see it, John. Oh, that’s a cool mug.

Todd: It’s a good mug. I got a mug from her university. But I didn’t realize I should have brought it. So I feel bad about that. But it is a podcast. So I didn’t think about what it would look like.

John: That’s true, we generally don’t do a lot of visuals on here.

Rebecca: And I have a blue sapphire tea in my Tea Rex mug.

Todd: Well, that’s a nice mug,

John: We’ve invited you back to talk a little bit about how some of the changes you’ve observed in college teaching across your career have impacted how you teach today. When did your work in higher ed begin?

Todd: Actually, it started when I was a graduate student. So back in 1987. So there’s no reason to try to figure out how old I am. Now I’ve basically specifically dated myself here. I started teaching, I got to teach an introduction to statistics course. And I had so much fun that I taught again the following year. And by the time I left my graduate program, I had taught more courses in that program than any other graduate student had ever taught in the psychology department there. I really loved teaching right from the beginning, when from the beginning, very concerned about student learning, and just getting rolling.

Rebecca: What was it about the teaching, Todd, that really got you hooked?

Todd: Just watching the studentsis. it’s the same thing as it is today, when you have an individual who’s struggling with something, and suddenly they get it and you realize that they may eventually get it on their own, but you realize how much you’ve helped them to move that along very quickly. And facilitating the learning process, I just really love that. That doesn’t mean I was fantastic at it. But I really did love it.

Rebecca: Sometimes the things we love the most are things that we’re not great at to start with.

Todd: That’s true.

John: My experience was similar, actually, I started in 1980, with a course where I had a fellowship, so I didn’t have to teach. But there was a sudden shortage in the department. And they asked me to fill in. And I was planning to go on into research. But it was just so much fun teaching that I’ve never stopped.

Rebecca: I taught as a graduate student too, and taught the whole time I was there. But I started a little bit later in 2003.

Todd: Alright, so that was a couple of years later.

Rebecca: Just a couple.

Todd: Yeah, I had kind of a funny start, I will mention that when I first started that after the first semester of teaching, my students got almost all As and Bs. And the department chair called me in and he said, “I’m not going to have you teach any more courses.” And I said, “why not?” And he says, “Well, you give grades away like candy, we have to have better standards than that.” And I said, “Well, how are you basing that?” And he says, “Well, you know, we looked at the grade point averages.” And I said, “Well, how about if I bring in my final exam, and just walk through it, and then you can tell me how it could change to be more rigorous.” And so it was great. I showed it to him at the beginning. And like the bottom of the first page, the students had to calculate a statistical value, then I had them explain how they came about that number. But if they had used a different test how might it been inappropriately found and what the interpretation might have been, based on the fact that they had done it wrong with a different test. I thought it was important for them to understand how these things can change. The Chair said, “I can’t believe you have your students in the first class actually talk about various tests like that.” And I said, “Yeah, I did. Then we turned the page he says “You did nonparametric tests?” I said, “Well, yeah, we did parametric tests, but then I thought they should know the equivalent.” And he said, “We never do that.” And then he turned the last page and he said “You had them do a two-way ANOVA? You’re only supposed to go through one-way ANOVA.” I said, “Yeah, but we’d finished everything and we still had a week left. And I figured I might as well introduce the next concept to them. And so I showed them how to do a two-way ANOVA and they ended up with all As and Bs. So if you could help me in how to push their grades down and give them lower grades, I’m perfectly happy to do that.” And he then set me up with two courses the next semester, but it’s that reliance on the teaching evaluations is always funny.

Rebecca: Todd, it’s just funny, as we’ve gotten to know you through the podcast [LAUGHTER] it sounds so perfect that that was your first experience. [LAUGHTER]

Todd: Yeah, I’ve lived my entire career on the edge. [LAUGHTER]

John: And those sorts of arguments are still occurring in a lot of classes today about rigor and the need to keep grades lower.

Todd: Yeah.

John: They’re less severe than they were a few years ago.

Todd: Yes, but also looking at how well a person’s teaching based on student evaluations. I mean, we should be looking at authentic assessment. Some things have changed through the years, some things have not changed through the years.

Rebecca: Well, technology is one of those things that has changed.

Todd: Woosh, yeah.

Rebecca: Can you talk a little bit about what tech was like in the classroom when you first started and how it’s evolved a bit?

Todd: Yeah, I know you have some listeners who have been teaching for a very long time. So those of you have been teaching for like 30 to 40 years, just stop and think back about what it was like when we first started. For those of you who have been teaching like Rebecca since 2003, let’s just mention that technology back then was mostly pens and chalk and chalkboards. So back then, of course, there’s technology, there’s always technology, but we were using overhead projectors. This was long before the internet came along to really be used in the classes. LCD projectors were not out yet. Canvas, Blackboard, Sakai, all those learning management systems were not around. We didn’t have any of the ways to email individuals, you couldn’t email your students back then. And there was no ChatGPT to write your papers for you.

Rebecca: But there were calculators that could do all the work for you.

Todd: Yes, but this is the cool part. Back when I started teaching statistics, I’m glad you mentioned the calculators, huge debate back then was whether or not the students should calculate the statistical values by hand using the calculator, because computers had just come onto the scene and we could punch the data into a computer and have a computer run an ANOVA for you. Should you calculate it by hand? Should you run it to the computer? And there was a huge camp that said you should do it by hand or you will never understand a statistical value. And I said, “You know, we’ve got the technology there. Why don’t we have the students use the computer to do the mundane stuff, and we’ll have more time to talk about the theoretical and the important implications.” But even back then we were having the discussions about whether to use the technology at hand or not. Oh, and by the way, we are also hanging grades on doors. So we would figure out the grades, we’d tack it to the door, and then the students who want to know what their grades were for the class would swing by and look at the door.

John: And they were sorted alphabetically, to make it easier for people to find where they were in the grade list.

Todd: Yeah, it was great. We listed them according to their social security number, [LAUGHTER] which was a little different back then. And yeah, we actually did that back then. But as John pointed out, they were listed by number so nobody knew whose number went with whom, except, surprisingly, they were alphabetical on the door. So not only could you figure out Armstrong’s exam score, you’d get Armstrong’s social security number as well. Yeah, times have changed.

John: And it was also back in the day of dittos and mineos as well, which was the only way of disseminating information on paper.

Todd: This is so much fun. We’ll get to some real meat of this thing. But that walk down memory lane has some fun stuff too. The dittos…

Rebecca: I remember dittos, just for the record, okay.

Todd: Yes. So you probably remember, if you dittoed just before class, and you handed it out in class, the students would all pull the ditto up to their face, so they could smell the ditto fluid. And they got that smell. I was running dittos one time in the graduate student office, and I noticed when I looked down because it ran out of fluid, and I had to put some more fluid in, and I looked down and I noticed that the floor was kind of eaten away by this ditto fluid. And then… this is the best part… About a month later, I was digging for something in the closet and I found extra tiles and I thought they should put these tiles down to replace the ones that are all eaten and on the side of the box it said these tiles were long lasting and durable, reinforced with asbestos. So that ditto fluid was eating through asbestos tiles. That’s some strong stuff.

John: …to make it a little bit more friable so that it would disseminate in the air nicely.

Todd: Well, there had to be something to help the faculty members who were running all their own dittos to not mind doing it, and one way of doing this is to have them use ditto fluid, because I’ll tell you, you may not have liked it when you started, but by the end, it was all right. [LAUGHTER]

Rebecca: It’s funny that we’re taking this walk down memory lane, because on our campus, I was in our historic lecture classroom today in Sheldon Hall.

John: What are some of the other changes that have occurred and how have they influenced how we teach?

Todd: Yeah, so it’s interesting, I did the walk down memory lane and we were chatting about this stuff. It’s all fun, but thinking about how the changes have taken place. I think that’s really important. So there have been massive changes. I think that we tend to forget, it’s so easy to communicate with students now. Heck, people are texting now so that you can text back and forth with students. But think about how that has transcended or gone through time. There was a time when I would have to call and leave a message for a student on an answering machine, and then they would call back and we would try to find a time that we could talk on the phone. If we wanted to have a conversation. I could either leave a note for the student or I could call and leave a message that says least come see me after class. So even having a conversation with a student was difficult, then it became easier with email because you could start emailing back and forth. And now we have Zoom. And the equity in the way that this has changed, just think about the difference of this, if I’m leaving a message for a student, they may not even have an answering machine, if they’re living off campus with limited means back then. So even getting in touch with a student would be challenging. Now I can have a Zoom conversation with a student who doesn’t have to hire a babysitter, who doesn’t have to find reliable transportation, who doesn’t have to drive across town and burn gas, and to do all of those things that it would take to have a 15-minute conversation that in the past would have been really hard, and even four or five years ago would have been challenging. The grades, why in the world would a person have to leave… and I was teaching in very northern Michigan, there were days that the wind chill was 75 degrees below zero… and students would leave their dorm rooms and walk across campus to see a grade on the door. It’s actually physically dangerous. And now we have learning management systems, we could post things for students. Interlibrary loan used to take weeks to get a document that you can now go on and get. People can lament all of these technological changes at times, but we’re actually creating more and more equity within the higher education system as we make certain things easier. Not saying that we’re anywhere near an equitable system yet, but we’re moving in a really good direction. And a lot of those changes are helping us to get there.

Rebecca: I’m thinking about all the times when I get to go to the door or meet after class, it really assumes that students are a certain kind of student, they’re full time, they have time. And our students now are working [LAUGHTER], and where they’re juggling a lot of different schedules and things.

Todd: Yeah, and I mean, we want to be careful too. And I agree with you 100%. But they were juggling back then too. But some of the things we were doing, for instance, I taught a night class. Now I would probably suggest if I was going to teach a class from 7 to 10pm that I would teach it through zoom, because there’s a lot of reasons that it’s good to do. But I had students that I noticed in class, would very quickly at the end of class would start talking to other students and I couldn’t figure out what it was doing because a lot of buzzing and stuff. And what I found was that there were certain students who were uncomfortable, and we were in a very safe campus, but they were uncomfortable walking to their car at 10 o’clock at night. So I started saying to the students, “Hey, I’m gonna park a car… and when we showed up, there were quite a few cars there… but I’ll be under the second light, I drive a little red Chevette, not a Corvette, a Chevette, but I’ll have my car there. If you want to park near me, we can walk out together.” And there were students that were not paying attention to almost any of the class because they were fearful of how they were going to get to their car safely. When you think about Zoom and stuff, it’s even safety factors, I would never have a review session now like I used to at 8 to 9 pm the night before the exam because I’m exposing people to potentially dangerous situations. Now we’d have zoom sessions. But I could tell you 40 years ago, there was no even concept of what zoom would be and how it would work. Even Star Trek didn’t have stuff like that.

John: And there was also, besides the inequity associated with people who were working, many campuses had a lot of commuting students who could not easily get back to campus for office hours. Or if they were just taking classes on Monday, Wednesday, Friday and your office hours was on a Tuesday, they’d have to come in that extra day, arranging childcare, or their work to be able to fit that into the schedule.

Todd: Yeah, it really did start to change that system. So we got a little bit more equity, and like you were saying too, the commuting students, the part-time students, the students taking distance courses. When I first started teaching, I was writing… oh my word, remember the correspondence courses? …and you mail away and get a packet of material, you take a test at a local library and, and they talk about distance education being not as good as on campus, but at least better than nothing. And now we’re finally getting to a system where we can stop assuming that those folks who are coming in for part-time courses and stuff are just getting something better than nothing. They’re actually getting something similar to full college courses, which some of those online courses are actually as good or better than college courses that are on campus. But all that’s changing with the technology. It’s crazy.

John: And there’s a lot of research that supports that in terms of the relative learning gains with online and face-to-face, as well as hybrid courses, which seemed to outperform others in a few meta studies that have been done. But those were options that just weren’t available back then. And the early online courses were often designed to be replicas of face-to-face classes, and they probably didn’t work quite as well. But we’ve learned since that, which brings us to the issue of research. During the time that you’ve been teaching, there’s been a lot of research on teaching and learning. While some of it was taking place, it wasn’t very widely disseminated to faculty.

Todd: Yeah, that is true, too. It’s so much easier to get technology out. It’s easier to gather data, it’s easier to write it up. It’s easier to edit it so all of those types of things that are happening now that couldn’t happen before. And as a result, we’re learning a lot more about how people learn, you know, the book I did on the New Science of Learning, looking at a lot of the ways that students learn. And part of it’s just the ease of getting to information. But also part of it’s just being able to investigate how people process information. I used to teach Introductory Psychology back then, we would talk about the stages of sleep. And nobody really knew, for instance, what REM sleep was about, we knew that you had to have it or else it caused some problems. Deep sleep we knew was important, we now have indications that deep sleep for consolidation is necessary for semantic memory. If your sleep is interrupted, you can get eight hours of sleep. But if you don’t get deep sleep, the information doesn’t get consolidated. Procedural memory, how to give shots and kick balls and do anything procedurally looks like it’s more solidified during REM sleep. So again, the different types of sleep are associated with us learning long term, different types of information. We never knew that before all this technology was running around. In fact, back then I gotta say, I remember from my intro psych class being told that you were born with a certain number of neurons, and as you live through life, neurons would die. And if you killed them by drinking or doing something like drugs or something, they were gone forever, and you would never get more. And if you broke a connection, it was broken forever. That’s just simply not true. But it’s what we thought back then. So technology has really allowed us to look better at how people learn, different ways of helping them to learn and different ways they can even study. By the way, before we move on, we now have this physiological demonstration that staying up all night and cramming the night before the test. Even though it gets you slightly higher grades on the test, we now know that because the information is not consolidated that it won’t be there a week later or two weeks later. So we’ve always told students, you shouldn’t do it, but now we can actually show them why it doesn’t work.

John: And the LMS itself has offered a lot of ways of giving more rapid feedback to students with some automated grading with some things to give them more low-stakes testing opportunities. And those were things that we just couldn’t easily do back when you started teaching.

Todd: No, John, that’s a really good one. And we know that one of the most consistent findings right now in all of learning and memory stuff is that the more often you do something, the easier it becomes, long-term potentiation. Which means the more frequently you retrieve information from your long-term memory, the easier it is to retrieve. And just like you’d mentioned, we can now do LMS systems that are set up so that you could do practice quizzes, you could do dozens or hundreds of practice quizzes and keep pulling that information out over and over and over again. That was just not possible before this. And so the LMS helps with that, it helps by giving feedback, really good feedback so that students know what they’re doing well, and what they’re not doing well. And it helps faculty members to design feedback specifically for certain types of projects, and so that I can more easily give more feedback without spending a lot more time on it. So LMSs have done a tremendous amount of work. And that’s not even mentioning the fact that you can have all of the LMS systems loaded with the content. So students can log in and get their information without leaving their house. If there’s fiscal challenges with your class, you can put in articles, the students may not have to buy a book, they could read the articles. And so we’ve got students who were able to come to classes because they can afford to be there. By the way, I remember being on a committee when I was a graduate student, and we were looking at financial aid and different financial systems. And I remembered asking the Chief Financial Officer, I said, “What increase in tuition does there need to be before you start to see students drop off because they can’t afford to be here?” And this was about 40 years ago, but he said $100 for a year, if they have to pay $100 this year more than last year, some students won’t come back. If we look at the price of textbooks now, textbooks can cost $400. So, a book like that is definitely going to make a difference between some students being able to take the class or not. So LMS systems make this possible.

John: And they also make it easier to share OER resources that don’t have any cost for students, or some less expensive adaptive learning platforms, giving all students that first-day access. I remember, not so long ago, when I was still using textbooks in some classes, students would wait several weeks before they got that book. And that put them at a severe disadvantage. And the people who were being put at a disadvantage. were generally the students who came in with the weakest backgrounds because they came from lower resourced school districts.

Todd: Yeah, if they had the resources, they would have the better background foundational material, but they’d be able to buy the books. And you mentioned OERs. So open educational resources are really another thing that are really valuable because back then, before the technology, you couldn’t produce something that would be readily available like throughout the world. And so this project that’s going on now where they’re doing introductory level books in all the different disciplines, you can get an OER introductory psychology textbook that students can log in and read. None of that was possible before the technology. So even the creation of OERs has changed so much.

Rebecca: Well, speaking of digital materials, libraries have changed significantly too over time from having completely physical collections and interlibrary loans and things that take a lot of time to having a lot of digital resources, which changes access to research and materials that you can populate into your classes, but also can aid students in the work that they’re doing. Can you talk a little bit about the change in libraries and how that’s impacted how you’ve taught?

Todd: Yeah, you know, libraries have been fascinating to watch over the last 40 years, because it used to be the biggest challenge librarians had before them was which books to put on the shelves because there was a finite amount of shelf space. And there were lots and lots of books. And so that was the big thing. We used to take out journals that weren’t used very much to make room for other journals. Through time, little by little, they started digitizing all that stuff. And I can remember chatting with librarians, one conversation I had was back around 2001. I said, gonna be interesting, because there’s gonna come a day where there’ll be no books in the library, and the Dean of Libraries said “Well, there’s always going to be books.” I said, “Not always, potentially.” But even if we reduce them, I said, “What is your foresight? How is the library going to change?” And so he had a couple of ideas. But what it basically boiled down to our conversation is, I always felt like a library was like the brain of the campus, it had the books, and it had all of the information that you could go and get. As the books left, and things were diversified in a way that you could find this stuff, you could get all the information right from your dorm room, or from your apartment, when the internet came along, you could get anything you needed, then the library was still a physical space that was in the middle of campus. And what it should become is a learning commons, a place where people go to share and to learn from one another. And I think that’s what’s really changed is individuals still just pile into libraries and use the space, but they use it in different ways. They go there to meet other individuals to work, which they did before. But they took away that aspect of going there for the book part. And it meant all of those shelves got emptied, and they started pushing them out. And you can go into libraries right now that have very few shelves. But they have webcams, they have smartboards, they have spaces where folks can plug in their computers and share with one another. They’ve got screens set up so that you can project and have students sitting around a table, they’ve got Google Glass set up, all of these types of things that bring students together to use technology to learn from one another.

John: And they have cafes to help support that to make it easier for people to gather.

Todd: Yeah, you could swing by and get a cup of tea.

Rebecca: It’s funny, even when I was in high school, my sister and I would rely on going to the library to have access to a computer so that we could even type of paper, because we didn’t have one at home. And that kind of place of having the technology started a long time ago, but it’s amped up quite a bit over the last 20 years.

Todd: Yeah, and I agree completely. And the computers that are there. I mean, even right now, with the books dissipating, there a’re still large numbers of computers. And oftentimes, they’ll even be an area in a library that’s carved out with really high-end computers. But it gives students an opportunity to go. We make this assumption that everybody has a computer and they don’t. But libraries give them that opportunity.

John: Yeah, for those students working on smartphones or Chromebooks, that gives them access to all the tools that students with $2000 or $3000 or $4,000 computers.

Todd: Yes, because smartphones can work for lots of things. But they’re a little tough to write a paper on

John: When I started teaching, and probably when you did too, the predominant mode of instruction, which actually still is often the predominant mode of instruction in many departments, was lecture. That’s changed quite a bit since then. Could you talk a little bit about the shift from lecture-based courses to courses that involve much more active learning activity?

Todd: Yeah, or they just involve a lot more of everything. The concept of flipped classrooms, which was almost impossible 30, 40 years ago, because you really couldn’t get the information to the students. Yes, it was kind of possible, but whoo, if it was hard now, it was really hard back then. But the ability to get information out to students that they can read it before they come to class. But coming back to the lectures… So I’m going to take this moment and those of you who know me know that I’m going to do this, is that we still have no evidence that lectures are bad, but there’s something that we need to really keep in mind. I think this is vital. I do think it’s important for us to be able to talk about buzz groups and jigsaws and fish bowls and lectures and Socratic lectures, discussion lectures, all those different methodologies out there so that we know what we’re talking about when we chat with one another. But I do think it’s time that we stop talking about lectures being more effective than one thing or fishbowls being more effective than something else and look at the components of what is valuable in a learning experience.

John: And a good reference for that is a book on Dynamic Lecturing, which you happen to be a co-author of.

Todd: That is true and in fact that there’s the Dynamic Lecturing. And then there’s a chunk in that about The New Science of Learning. And then there’s a whole chapter in that about Teaching at its Best, because that’s a good point, John, thank you.

Rebecca: It’s almost like you’re trying to slip it in everywhere you are.

Todd: Because the research… people keep talking about one methodology being better than another. Here it is, folks, you can be a hideous lecturer, you can be a phenomenal lecturer. And if you’re a hideous lecturer, you’re not going to learn anything. If you’re a phenomenal lecturer, students will learn from you but they won’t learn all the time, it depends on some student factors. I’ve actually been exposed to group work in flipped classrooms that were awful. And so that concept is we start thinking about and this is why it’s going to come back to the technology, we think about the elements that need to be there, that are necessary for learning to take place. I’m just going to do this, because it’s not the topic I’ll make it very brief, is let’s just go with three things. If you don’t have your attention, as a teacher, if my learners aren’t attending to what I’m saying, if they’re on their phone or thinking about bacon, then they can’t process what I’m presenting. And if you’re having a think-pair-share, if they’re not attending to the person they’re sitting next to, you have to have attention. Number two, they have to have some value. If I’m hearing somebody or I’m reading something, and this has no value to me, it’s really hard to get it into your long-term memory and to learn it. And number three, I have to have a clue of what’s happening, I got to understand some aspects. Now if we think about attention, value, and understanding, now we can flip back to the technology. This is why gaming works. Gaming draws the attention, it increases the value, because you want to win the game, and it has understanding. We have all played games. You open up the old board games, and now it’s digital, where you don’t have a clue what the game is. It’s like, if you advance a player four pieces and the opponent advances five pieces, you have to go back three spaces, unless it’s a Tuesday. When those instructions are that complicated, you don’t understand. So we can use technology to help with attention, we can use technology to help with the value of what’s going on. And we can use that technology to help with understanding. Those are things that were very difficult before. And they allow us to do things like a mini lecture and then shift over to an active learning exercise, and then say, take all this information and create a Zoom session tomorrow that will go over it again. So the technology has really helped us to be able to do all of these things to get at the core of learning, a topic I barely care about. [LAUGHTER]

John: That’s an important one, because people often see this as this binary issue where you lecture or you use active learning. And there are some really effective ways to combine them. And in fact, in that book on dynamic lecturing, it was suggested that lecture can be more important in introductory courses, when students don’t have as much of a knowledge base.

Todd: You’re absolutely right. Discovery learning is a really great way to learn if you’ve got a lot of time. I can just put you into a room with some other people and say, “Here’s some data, and here’s some things we need to know. Go.” And if you don’t have any foundational knowledge at all, it takes forever to figure it out, you go online, you know what to look for, I could do a five-minute lecture, and at the end of five minutes, set it up and say, “Now go and work with your neighbors. In fact, here’s what we’re going to do, we’re going to have you each work in small groups in class, I’m going to open up a Padlet. At each table, I want you to go in and add your information or put it into the column that corresponds with your group number.” As an instructor, I can watch everything develop in front of me. While I’m in the room, I can look at my laptop and see it and walk over to a table and say, “looks like you’re struggling a little bit.” I’ve lectured, I put them into small groups, I’ve had them use technology, I’ve created a little bit of competition on who can come up with what and I’ve had a way for me to monitor it and give them feedback. That is so different than what teaching used to look like. So pulling it all together, that’s what we do.

Rebecca: The tools to be able to monitor have been really helpful in my own teaching and being able to get a better pulse on what’s going on and get a nice overview and then be more targeted in how to interact with small groups rather than just kind of wandering around more aimlessly like I think I did initially. [LAUGHTER]

Todd: Yeah, and this is all going to be great until we get our cognitive load headbands that I’m waiting to be developed. So anybody who’s listening, take this idea, run with it, you can make a bazillion dollars and then take me out to dinner or something. I want a headband and the headband has a light and it measures brainwave activity. And then as I’m teaching, if you start to be a little bit like it’s a little bit too much, you’re moving out of that zone of proximal development, the light turns from green to a yellow. And then when it hits red is like when you’re trying to put together an Ikea bookcase and someone comes by and says “What do you think of this?” and you say, “Errr, I’m working on an Ikea bookcase right now.” …that shutting down with that red light. I’m telling ya, that’s going to be the technology we’ll want next.

Rebecca: It would be so helpful. [LAUGHTER]

Todd: You can actually look and see somebody else’s zones of proximal development and their cognitive load. Whoof. Which by the way, there’s a little party game that they’ll do periodically at parties. It’s like if you’re a superhero, what would you want your superpower to be? And I was in a room one time and one person said they wanted to fly and somebody else said that they wanted to be invisible, which real quickly in my head, I’m thinking, what could you possibly gain that wasn’t illegal or creepy if you’re invisible. So aside from that, transporting and everything else, and they got to me, and I said, “I want to be able to see people’s zones of proximal development. If that were my superpower, I’d be the best teacher.”

John: I bet that went over really well at those parties. [LAUGHTER]

Todd: Yeah, my friends all said “You are amazingly smart and quite insightful.” They used different words, but that’s what I heard. [LAUGHTER]

Rebecca: They didn’t start with what is that? [LAUGHTER]

Todd: As soon as I start talking, most of my friends just shake their head and drink whatever beverage they have near them. [LAUGHTER] So yeah, it’s good times, good times. They’re all impressed. They don’t say it all the time, but I know they are.

Rebecca: I think one of the things that often happens with technology is that it allows us to get things quickly and move through things quickly. But sometimes, as you just noted, learning doesn’t happen quickly.

Todd: Yeah.

Rebecca: Can you talk a little bit about speed and the difference between maybe not having all the technology and all the things really quick versus maybe now where we have it at our fingertips, but do we always want it at that speed?

Todd: So there’s another study that I’m waiting to see. This is an easy study, folks, somebody can run this one quickly. We all know that students are listening to any recorded lectures or recorded material that they have to watch, 1.7 is about the best speed that we tend to see people listening. 2.0 is a little bit fast for some folks. 1.0 is like normal speed, that’s no good, too slow. So what I’m curious about is the space between words and between sentences that our brains, because they move so fast, we can listen faster than somebody can talk. And we have all this other stuff going on is I can be thinking and processing while you’re talking to me. But if I bumped that up to one seven, I think we close the gaps. And I hear it a lot faster. But what I don’t think is happening is the cognitive processing while I’m listening. The active listening component to it. So I think technology can create concerns in those directions. And students who do try to process material too fast… we’ll wait and see.

John: And that’s especially important in flipped classrooms where students do watch these videos outside. One of the things I’ve been doing with those, though, is embedding questions in the video so they can watch them as quickly as they want. But then they get these knowledge checks every few minutes. And then if they find they’re not able to answer it, they may go back and get their attention back and watch that portion again.

Todd: Yeah, I think that’s a really good way to go. EdPuzzle’s kind of a fun technology to use. I don’t know if that’s the one you used.

John: I’m using Playposit, which is a bit more expensive, it works beautifully. I love it, they did just double the price this year, though, it was bought by a new company.

Todd: This is the tricky spot now as the prices are going up. You know, inflation is a terrible thing to waste. Anytime somebody can raise prices now it’s like, “ooh, inflation”. So you know, prices double, inflation is 8% with runaway, now it’s back down around three. But when inflation was 8%, they doubled the price and say, “Hey, we’ve got to,” but yes, it’s some of them are expensive. There’s lots of things that are less expensive. Oftentimes we pay for functionality that help us but the freemiums kind of thing. So stuff that’s inexpensive. I just wanna let everybody out there know just about anything you want to do in class or can think about doing it, there’s a way to do it for either free, or probably under $100 a year, which I know $100 can be expensive for some people, it’s about eight bucks a month. And so things like Padlet that I think might be up around 140 now, so maybe $12 a month, can change how much time you spend doing things, and how much time for students. But yeah, I love the embedded questions to help slow things down.

Rebecca: I think that the cognitive load can happen really quickly if we’re piling lots of information in but not always providing the time to process and use that information in some way in the kind of activities that you were talking about. Or knowing when everybody’s red light is going off in the class.

Todd: Or when people try to do multiple things. I mean, now you’ve got the technology around. So if students are trying to listen to an assignment while they’re texting their friend and have a TV on, I mean, we’re living in an age where there is a lot going on, and people believe they can process lots of things. Evolution doesn’t happen quite that fast. And so I think we have to be careful with that one.

John: One other thing that’s happened is back when you and I both started teaching, the only way students generally communicated their learning was either on typed pages or on handwritten notes. Now we have many more types of media that students can use. And also we’ve seen a bit of an expansion of open pedagogy. How does that help students or how does that affect student learning?

Todd: Wow, that’s really changed a lot as well. Blue Books. Remember the blue books? I think they still sell blue books in the library. They may cost more than the I think it was eight cents when I started, but the concept of writing things down, you turn them into the faculty member, the faculty member would grade them and turn them back. One of the big things that I caught years and years ago was so much wasted cognitive energy in terms of what they produced. I’d read a paper from a student and think this is amazing, and no one will ever see it. It was written for me, I graded it. And now it’s done. I think the technology has changed so many things. One of the biggest things, I would encourage all the listeners, any faculty member out there is, whenever possible, create something that will take the students’ work, the things that they’re doing, and use it to make society better. It’s not that hard. There’s assignments that you can do on Wikipedia. Anybody who wants to complain about Wikipedia, if you don’t like it, I’m gonna go back to Tim Sawyer, who is a faculty member of mine, my very first time I ever did TA work. I was complaining about some students. And he said, “You can complain three times. And after you’ve complained three times, either stop talking,” he was a little bit ruder about that, “or do something about it… just shut up or do something.” And so I complained about Wikipedia for a while, that it wasn’t all that effective. And I thought, well, if I don’t like the page on cognitive load on Wikipedia, I could give an assignment of my cognitive Psych class to go on to Wikipedia and fix it. And so you can have Wikipedia assignments, there’s so many things you could do. Here’s one for you. If you’re doing one on communication, you could have your students go and take pictures or short videos somewhere on campus of something that’s meaningful to them, and then jot down why it’s meaningful, take that compilation of stuff and send it over to the office on campus that does publicity. What better way of drawing students to campus than to have all of these students that have said, I love sitting by the pond because… and in the past, we would have had students write a paper about someplace on campus that you think is effective, put it in the blue book, we would grade it, we turn it back to the students. And that is a waste of possibilities. And so I think we do have lots of ways that we can get the students involved in helping through technology,

John: One of our colleagues in SUNY, Kathleen Gradel, had an assignment for a first-year course, where the students went out, took pictures, geocoded it and added it to a map layer that was then shared with other first-year students about useful resources on campus and their favorite spots on campus, which is another great example of that type of authentic learning.

Todd: Yes, for the authentic learning, there are just so many possibilities because of the technology. If anyone doesn’t have ideas, ask deans, ask the provost, ask the president on your campus, like what kind of information would be helpful, either for the next round of accreditation or for just helping the campus and we can design those things. Another one I did was we took students to the museum. We’d go to the museum, almost any class could kind of find some way to tie museums in, and through the museum, not only would they write stuff that the folks at the museum who did curation would help use, but also just helping the students to see how issues from the museum, how artifacts and things can be used in their own life, to better understand.

Rebecca: When I first started teaching, community-based learning was popular, in fad at the time, and I think having the experience of being a student in a class like that, but then also a faculty member teaching classes like that has really informed the kinds of projects that I do. Maybe they’re not always community-based learning, but they’re often community oriented, whether it’s the campus or even the surrounding community that the campus is situated in to help students get connected. There’s so many nonprofits that need partners and love, there’s always a project that can be done. [LAUGHTER]

Todd: There is. And I used to be a director for a service learning component of the campus. And yeah, there’s just so much out there that we can do to help others.

Rebecca: And students always had such a strong connection. And they didn’t want to fail because other people were depending on them. And so there was a real investment in the work that they did on projects like that.

Todd: I will admit that I’ve never experienced it myself. I’ve never even heard of anybody that if the students are doing some kind of authentic learning, that their authentic learning is then used to help somebody else. I have never heard students say “What a waste of time” or “I hate that class,” or “those assignments are just busy work.” They’ve never used those terms.

John: One common sort of project is to create resources that could be shared with elementary or secondary school students in the disciplines. And again, they can see the intrinsic value of that.

Todd: Yeah. Students could write short manuals on how to learn and then pass that on to the first-year students. And so upper-division students could be helping the lower-division students because not everybody can get a copy of The New Science of Learning, third edition.

John: …available from… [LAUGHTER]

Todd: Available at… used to be Stylus. Since Stylus was sold to Routledge, now it’s available at Routledge. [LAUGHTER]

Rebecca: Given the historical background that we’ve walked through today, what if we think about the future? Where do you see technological changes or learning theory changes impacting the future of higher ed?

Todd: Yeah, we’re living at an interesting time. I like to point out to folks that when you go back to Socrates, Plato kind of time there was a thought that if you wrote something down, it would weaken the mind so we shouldn’t write things down. Luckily, some individuals wrote things down or we never would have known. We’ve gone through several iterations of those kinds of things. Samuel Johnson, I believe it was, who said “With the ready availability of books, teachers are no longer needed. If you want to learn something, you could go get a book on it.” Well, that was a couple of 100 years ago. And we still have faculty members, we have students writing things down, we’re reading, I don’t imagine how you could teach without writing things down and having books. The internet came along, as we were discussing earlier, while we were teaching, we watched the internet show up. And there were people who said, “Well, with the internet, there’s going to be no need for teachers anymore, because students can get whatever they want.” I can’t imagine teaching without the internet right now. So as we’ve gone through each of these iterations, there’s been this fear that maybe we’d be supplanted by some technology followed by “I don’t know how I’d work without that,” it’s a little trickier now, because with generative AI, we’re talking about not just something being available, but actually creating something. I don’t know what that’s going to look like. But there’s some real possibilities that the generative AI ChatGPT, could do things like help students who have writer’s block, get started. And that’s an individual that maybe could produce something really cool, but just can’t get started. I didn’t publish my first book until about seven or eight years ago, because I’m one of those individuals who has a terrible time from a blank screen. I just have a terrible time with that. And so now, I don’t use ChatGPT to actually write anything significant. But I will tell you that I will use it for the first paragraph. That’s all, just one paragraph. And then I completely rewrite that. And there’s no actually trace of it. But it’s something that gets me going.

John: So can we count on more than a book a year going forward? [LAUGHTER]

Todd: No, no, no, no, you can’t. So exhausting. But the concepts that will help students that can do that, I think that’s going to be helpful for them. So there’ll be a type of student who couldn’t have produced before, but now can. We are definitely going to run into some challenges, though, with students who are going to just use generative AI and use artificial intelligence to actually create and to hand something in instead of doing the work. So I do think we’re in a challenging time right now. And I wouldn’t make light of that. There’s actually something that I find fascinating from this. Right now, more than ever before, we can actually have artificial intelligence create something for us, especially in higher education, this hasn’t been done before. The tricky thing is that we were the ones to be able to make that possible, because we learned things. If we let a machine do that work for us, we’re not going to be put into the situation or our students coming along, will not be put into a situation where they’re intelligent enough to do the things that need to be done when they need to be done. And so I do think we’re facing a real dilemma right now. If my students, for instance, always do use some artificial intelligence to create a paper and hand it in, if I can’t catch it, they may end up with an A in that portion of the class. But there’s going to come a day when they’re going to have to write something or be able to read something and tell if it’s written well. And so I’m a little bit nervous, we’re entering a phase where by bypassing some cognitive processing that needs to be done, we may be limiting what we’re able to do in the future. Wrapping this up, though, I don’t want to be the person who says if you use a calculator, you’ll never understand this statistical test. So I don’t know where the balance is. But I do think we’re going to have to have decisions coming up that we’ve never had before.

John: Generative AI is drawing on that wealth of knowledge that has been produced. And for that to continue to grow in the future, we do need to have some new materials being created. So that is an interesting challenge, unless it goes beyond unless….

Todd: …unless it creates it. So that was one I thought about, by the way, sometimes you’re sitting around just thinking about stuff and it’s interesting. I was thinking how do I acquire new information. And the way I acquire new information is I go read articles, I read books, I read a ton of stuff. And then I say I think this is valuable, I don’t think that’s valuable. And then I put it together and say here’s what I’m thinking. And now I’m looking at this generative AI who goes out and scans the environment and pulls these things and then creates something new. It doesn’t have the cognitive processing that I have at this point, but…

John: it’s in the early stages.

Todd: We have some folks who are very concerned out there, especially in European countries that are starting to put some guardrails out, because at the point that it keeps grabbing stuff, and then generating and then it grabs the stuff it generated, then it’s going to be interesting. But as of right now, I just read another article, I think it was yesterday, that they’re going out and grabbing the most popular or most frequently written things and then putting it down as if that is right.

Rebecca: The way that you might prioritize as a human with an expertise in something, is going to be really different than a system that’s prioritizing based on popularity, [LAUGHTER] or like how current something is like when it was last published. That’s a really different value system that really changes priorities.

Todd: Yeah, and I think it changes how we teach. I think the way we teach is going to fundamentally shift because we’re going to have to work with students with all these things being available and explain to them and talk to them about the learning process and the value of the learning process. And keep in mind, this isn’t just about ChatGPT writing papers, everybody’s freaked out about that right now. We shouldn’t lose sight of the fact that you could get fresh, cleanly written papers that have not been plagiarized at all, we’d be able to do that for 20 years. There are paper mills, I can either write away or contact somebody and say, “Please write me a 10 page paper on Descarte, and they would write it, I could turn that in. What actually has happened recently is that everybody can do it, even those who can’t afford to have a paper written at $10 a page or whatever it’s costing. And so equity comes back again. [LAUGHTER] Now we’re an equal opportunity cheater. So we have to be careful with that. But I think the way we teach is going to change because all that information is going to be available, kind of like the internet on hyperspeed. And then what do you do with that? It’s going to be really intriguing. I think it’s an exciting time.

Rebecca: So Todd, this episode’s gonna come out right at the beginning of this semester. So you’re saying we need to be thinking about how to change our teaching. ChatGPT’s here, what are you doing for the Fall differently?

Todd: Well, I think the biggest thing is what we were just talking about, looking more at the learning process, which has been a big thing for me for the longest time, is explaining and talking through the learning process, I can hand you all this information, but if I hand it to you, you don’t learn. In fact, one of my favorite examples came from a friend of mine, and it was the gym, if you want to get in better shape, I could pay somebody to go do sit ups for me. And then I could somehow log in the book at the gym that 100 Sit ups were done, use the passive voice there, and somebody else did them for me, I’m not going to get in better shape unless I do the situps. So I have to do the work, I have to run, lift weights, do the situps in order for me to be able to gain. We need to just turn that into a cognitive process for our students to really gain cognitively they have to do the work. And so I think more than ever, it’s how do we convince students of that? And for the faculty members who say, “Well, that’d be great, but my students just want the grade.” If that’s the case, we have a bigger problem than whether or not some technology can write a paper for them.

John: So how do we convince students that it is important for them to acquire the skills that we hope they get out of college?

Todd: I think this is probably going to come down to the community building, it’s been there forever. If you really want your students to do the work, the best thing you can do in my view, and that’s why I’m gonna say, Rebecca, I don’t think a lot for the way I teach, has changed. You build a community, you build relationships, you talk to the students about importance of things, if you’re sincere about that, and they get that then yes, there’s going to be some students that are going to mess with the system, they have always been there. But you’re also going to get a lot of students who will say, “Yeah, that’s a good point.” And then they’ll do the work. I don’t teach as many undergraduates as I used to, I’m teaching more faculty than ever because of being the faculty developer. But there were years that I would have to tell my students don’t put more time than this in on your paper, you have other classes, you need to do the work in the other classes. Because, and I’m telling you, I am very proud of this, my students would spend a ton of time on this stuff for my class, because they didn’t want to let me down. And I would say you’ve already got an A, I’m proud of what you’re doing, please go work on your other classes. That kind of scenario happens when you build community. And I’m not saying it’s easy, I would never say it’s easy. And it’s not going to happen for everybody. But it is the foundation of good teaching.

Rebecca: So we always wrap up by asking, what’s next?

Todd: There’s just so much going on right now. I think that what’s next for me is I am still in that headspace of coming kind of back from the pandemic, anybody who says, “Yeah, but the pandemic’s all over,” wait for November, we won’t know, we’re going to see. But I still think that’s next is kind of thinking about how we teach and learn in this environment. So moving in that space, it’s probably not surprising. I’m working on the next book here. One of the things I want to do now is the last couple of books that I’ve done had been pretty heavy books. And now I want to write something that’s a little bit lighter. So it’s going to be more of a quick guide with more narrative and having some fun, I love telling stories. I love having fun with people. So I’m going to try to create a book that’s kind of like a science of learning and teaching at its best but really accessible and more of a story-based kind of way of looking at things.

Rebecca: Who is your audience for that book?

Todd: Anybody who will read it? [LAUGHTER] Anytime I write anything, I have to have the audience firmly in mind and think about who am I talking to. And I really believe there is a pretty big overlap with students and faculty who don’t know specific things. And I’m not saying this in a mean way toward any of my faculty colleagues at all. But there’s a lot of people who aren’t taught about things like long-term potentiation and deep sleep in terms of semantic memory, and looking at depth of processing and those types of things. So the same type of thing we can say to a student, we know you shouldn’t cram, but here’s why you shouldn’t cram… faculty learn a lot from that as well. And so my audience for this book is going to be faculty and students, students, because I think it’ll be more fun to read about how to learn in a narrative form like that. And faculty because it’s more fun to learn when you read in that kind of a format for some people. we’ll see.

John: And if faculty design their courses to take advantage of what we know about learning, it can facilitate more learning.

Todd: Wouldn’t that be cool? We could just keep rolling, rolling. What a great amount of work. I mean, a huge amount of work that faculty do. They’re hard working folks that are just cranking away all the time. Number one, making their life a little bit easier by helping to understand things would be great. And just having a little bit more fun would be fun, would be nice way to go to0.

Rebecca: Hey, anytime you can save time, so that we can have more play in our lives is better.

Todd: Yeah, just to do whatever you want to do.

John: Yeah, ending on a note of fun is probably a great way to end this.

Rebecca: Well. It’s always great talking to you, Todd. Thanks for chatting with us and going on the Wayback Machine.

Todd: Oh, you know, I love the Wayback Machine.

Rebecca: I love it too.

Todd: For those of you who don’t know about that, you should check out the Wayback Machine

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

290. Transparency in Learning and Teaching

While instructors know what they expect from students, these expectations are not always clear to their students. In this episode, Mary-Ann Winkelmes joins us to discuss what happens when instructors make their expectations transparent to their students.  Mary-Ann has served in leadership roles at campus teaching centers at Harvard, the University of Chicago, the University of Illinois, the University of Nevada – Las Vegas, and Brandeis University and is the Founder and Director of TILTHigherEd.

Transcript

John:While instructors know what they expect from students, these expectations are not always clear to their students. In this episode, we explore what happens when instructors make their expectations transparent to their students.

[MUSIC]

John:Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John:…and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guest today is Mary-Ann Winkelmes. She has served in leadership roles at campus teaching centers at Harvard, the University of Chicago, the University of Illinois, the University of Nevada – Las Vegas, and Brandeis University and is the Founder and Director of TILTHigherEd. TILT is an acronym for Transparency in Learning and Teaching in Higher Ed. We are very much fans of the TILT approach and have referred to it often in workshops on our campus (and on previous podcast episodes). Welcome, Mary-Ann.

Mary-Ann: Thank you. I’m really delighted to be here with you. And I appreciate the opportunity to speak with you on Tea for Teaching.

John:We’re very happy to have you here. You’ve long been on the list of people we’ve wanted to invite. So we’re very pleased that you’re here today. Today’s teas are:… Mary-Ann, are you drinking tea?

Mary-Ann: I am indeed. And I’m drinking a Sencha green tea today. That’s my new favorite kind of green tea, Sencha.

Rebecca: Nice. I have English breakfast today.

John:And I am drinking a mixed berry Twinings black tea…

Rebecca: Hmmm.

John:…which I haven’t had in a long time. I wanted to mix it up a little bit today.

Rebecca: …mixing it up with mixed berries. So, Mary-Ann, can you tell us a little bit about how the TILT project came about?

Mary-Ann: Sure. This was years back, I want to say in the early 2000s, late 1990s, where I was working at the BOK Center for Teaching and Learning at Harvard University. And I was leading a seminar group discussions about teaching and learning. And we began to think about the question: “What happens when you tell students why you’re teaching how you’re teaching, just what happens when you tell the students more about your choices as an instructor, how you’re choosing to shape the learning experiences for the students?” And that’s not often something that we think about first when we’re thinking about what’s the content of the course. But we began to think about that a lot. And we had a kind of metaphor about the Wizard of Oz, and pulling back the curtain to show what was happening behind the scenes to build the experience. And then somehow through that conversation, the word transparency emerged. And that became the word that we used pretty regularly from that time on. When I moved to the University of Chicago, that was the word we were using, and it kind of stuck. So that’s kind of where it started. And it started alongside of my career as an educational developer. And it’s kind of been, for me, in the background or on the side, as something that I’ve been kind of tracking along with as a project. It’s still there, it keeps going. And just about a year ago, I began to work on TILT as my full-time job, which I’m really happy to be doing now because it gives me an opportunity, not just to do a guest talk here or there, or a keynote address, which is usually a one time-interaction. But now I have the flexibility to connect with institutions around a longer-term project. So if there’s a faculty learning community that emerges from a first talk that I would give, I get to follow up with them later and see what’s happening and check in with them. Sometimes I get to see the assignments before and after, which I really like. And I invite those now, because we’d like to publish some of those on the TILThighered.com website. And there are some schools that I’ve been working with in the state of Washington for several years now running with their TILT projects. And that emerged from a project we did with the entire state system of Community and Technical Colleges in Washington State. So I have opportunities now like that, where I can work with larger scale TILT projects that take more time, because this is my full-time job now. And I’m really happy about how that’s working, because I feel like it’s getting larger beneficial impact for students in a way that’s more efficient than when my full-time job was at an individual institution.

John:Could you give us an overview of the TILT framework?

Mary-Ann: Absolutely. So the TILT framework is meant to be a very simple tool that is a framework for an ongoing kind of communication among teachers and students. And in all of our studies, we asked teachers to use this framework in their own way at their own discretion, because we know that it’s not really possible to expect that people would do the exact same things with it. So our research is based on the premise that people are using this framework in their own way, at their own discretion, in a way that feels consistent with their teaching style. So there are three parts to this framework: purpose, task, and criteria. And what we ask in all of our studies is for teachers to engage students in conversation about three aspects of a particular assignment or a project or even an in-class activity. Before the students do a piece of work that we want them to complete, we’re asking for teachers and students to have a conversation about three aspects of the work before the students start working on it. And those three aspects are the purpose, the task and the criteria. Now the purpose kind of consists of two pieces. The first part is talking about the skills that students will practice while they’re working on the assignment. And then how are those skills useful, not just now in this course, or maybe in college and other courses, but how are these lifelong learning skills that will be useful for the student in their careers after college or in their lives ongoing? And then the second part of the purpose is about the content knowledge. What new information or what disciplinary information will the students be researching, or gaining, or applying when they’re working on the assignment? And how will that be also similarly useful to them, not just now, or in college, but beyond in their lives? The task, that’s the second part of the TILT framework, and the task is sort of about what are the teacher’s expectations about how students will approach the work? And for the students, it’s kind of like mapping out their game plan, like, what’s the first thing they will do? Will they Google something? Will they go to office hours? Will they go seek out a research librarian? Will they go into the lab and start mixing something like, what’s the first thing they’ll do? And then a sequence of what they plan to do after that until they submit the work. In an ideal world, the teachers and the students would have similar expectations about how that would go. In some cases, though, teachers have a pretty legitimate pedagogical reason for hiding that, that they don’t want students to know how to do the task. And I found this to be the case, particularly in fields where creativity is really important: performing arts, studio arts, even engineering or some STEM courses, where teachers really want students to cast about for a while and kind of use their imagination and see if they can come up with something unique, if not into the discipline, at least unique for the student to try to figure out some new process. And there’s value in that. When teachers want to do that, we did have some pushback from teachers in our original TILT research studies, where they said, “What happens if we don’t want to tell students how to do the work, like part of the task is for them to figure out how to do the work?” So in that case, we asked for those teachers to just say something like, “Part of the purpose of this assignment, in addition to the skills and the knowledge we’ve talked about, part of the purpose is for you to struggle and feel confused, while you invent your own approach to the question.” And we think this is what helps to preserve the student’s sense of confidence and their sense of belonging. Because instead of having that moment of panic of “Oh, no, I don’t actually know how to do this, I don’t even know where to start, I don’t know where the resources are, I don’t know what I’m doing. Maybe I shouldn’t be doing this, maybe this isn’t for me, maybe I shouldn’t be in this major, or in this course.” Instead of going to blaming it on themself or to questioning whether they’re up to the task at all, students can say instead, “I am totally lost right now. And that is exactly where I’m supposed to be. I know I’m on track. I’m doing great. This is the confusion part that comes before the clarity. And I know that because we talked about that and the professor said, this is part of what we expect to happen. This is intentional, this confusion, you’re supposed to feel lost right now.” So that’s sort of what we can say about the task. And the benefit of students knowing upfront what the task is, or knowing how they plan to approach the assignment or the project, the benefit there is that students get to spend 100% of the time they’ve allocated to work on this project, doing their best quality work, and they don’t lose time trying different approaches to see if this or that is going to work or looking for resources that aren’t what the teacher intended for them to be using. Instead of losing time, on the “how,” students get to spend their time so that what teachers receive then is most of the time what we’re looking for, which is “What is the student’s highest capacity right now?” Let’s see an example of the best work that the student can do right now, so we know where they’re at and we can bring them further so that they can advance in their learning. But if we accidentally end up in a situation where a teacher didn’t intend for the students to be confused, they expected the students to take a particular approach that they may have even mentioned at some point in class. So that’s why they think the students know that that’s the expected approach. I don’t want to say the correct approach but at least what they expect students to do. So if we think that students know how to do what we expect them to do, and the students don’t know what we’re expecting them to do, then there’s this chunk of lost time, where what we’re measuring then in the end is what happens after the students spend a chunk of their time lost trying to figure out how to approach the work, and then whatever time is left after that doing their best quality work in the amount of limited time that’s left. So part of the “task” piece of the framework is about what do we want to measure? Right? Do we want to be assessing the best quality work that students can do? Or do we want to be assessing what happens when you give a really varied, diverse group of students a particular assignment to do and you don’t give them 100% clarity about how to do it, and then kind of what you’re measuring is which students have, through no fault of their own, not encountered that information in their lives before coming to this course. And then you also get to identify who are the students that maybe because they had some other kinds of privileges that not all the students had, who are the students that can figure it out faster, because they come equipped with those privileges. So you can begin to see that this is an equity issue. So if talking about the purpose of the assignment kind of speaks to the student’s motivation, and to the value that they will gain from doing the work, and maybe to their ability to assess if they’re getting that value while they’re doing the work, the task speaks to even more of an equity situation where we’re trying to get all of the students to the same starting line of understanding of how to do it, and of having all the resources they would need to do the work to complete the work. And we want to make sure that students are all at that same starting line before they start the assignment. So that’s kind of the equity piece of this. And then finally, the third part of the framework is about criteria. We want students to be able to understand while they’re doing the work, how well are they doing. We want them to be able to make corrections, if they end up with a finished version that doesn’t look like what successful work would look like in this kind of a scenario. But if the students have never seen what successful work looks like, and they probably haven’t, because why would you assign them to do something that they’ve already seen many examples of; they wouldn’t be learning anything new. So kind of by definition, students aren’t going to know what successful work looks like when it meets this or that criterion in the discipline. So what we encourage teachers and students to do there when they’re considering the criteria is to offer students more than just a checklist or a rubric, because the words on a rubric or checklist might mean something different to the student who hasn’t done this kind of work than they do to the teacher who’s really immersed in this kind of work. An example I sometimes offer is, let’s say, I asked students to write up an analysis of a 15th century wooden painted sculpture of the Madonna and child from when I was teaching Italian Renaissance art history courses. In an art history course, the word analyze, like the tasks, the actions that you take when you are analyzing something, that’s a very, very different activity than analyze in the context of an economics course, or in the context of a chemistry course. But if the student hasn’t done this kind of analysis before, you can’t know for sure that they know what you’re asking them to do. So we kind of have to talk that through and students are going to need to see some examples of real world work in the discipline so that they can, with you, in a class meeting, talk about how do we evaluate analysis in this example from the real world, or in that example from the real world. And you won’t find any one example that matches every criterion of the assignment you’re asking students to do, usually, so you need several examples. The benefit of several examples is also that you can begin to talk about the relative success with which different examples are meeting a particular criterion as well. So once we’re in a conversation with students, and we hear back from them, that they’re telling us, what we had hoped they would understand about the skills they’ll practice and the knowledge they’ll gain, that purpose, about how they’re going to approach the work, the task, and about how they’ll know that they’re doing good quality work, the criteria, once we hear students telling us that, that’s the moment that things have become transparent. It is that activity of communication, that conversation with students about purposes, tasks, and criteria, that’s where the transparency comes from. And when we are done with that conversation, we know that students are at the same starting line of readiness In terms of their understanding of what they’re going to do, and also, in terms of their confidence that everyone has the resources that they need, in order to complete that work

Rebecca: What faculty believe is important for students to learn doesn’t always align with the goals of students. Can you talk a little bit about some strategies for bringing these into better alignment?

Mary-Ann: Sure, I think that this kind of speaks to the purpose part of the transparency framework. And often teachers are expecting students to learn something that is very valuable, we wouldn’t spend our time teaching things that don’t have a lot of benefit for students or that they would only use today and it wouldn’t be useful to them later in life. We like to teach things that have value. And so, when we are communicating with students about that value, we’re talking about the skills that students will be practicing. They won’t perfect them on this assignment, but they will begin to strengthen a particular kind of skill set. And they will gain some sort of disciplinary knowledge that can be useful to them later. And we know that sometimes disciplinary knowledge changes over the years as people discover new things and publish new things in any field. Sometimes that knowledge changes. But having some knowledge now does give you important value if you’re going to continue in that discipline or if you want to understand basic principles of a discipline that you might find useful elsewhere. So if students and teachers have a transparent conversation or communication, it could be a written communication, it could be something that they record and put on a website, it could be an asynchronous kind of conversation in an online course. But whatever form that communication takes, I think students and teachers when they’re on the same page about what the knowledge is, what the skills are, that are the focus of this assignment, students will feel more motivated to do the work, because they’ll see that it has benefit for them. And it doesn’t feel like a rote exercise, or just churning out another problem set or another art history analysis paper. There’s some value here that the students know upfront what that value is. And when the teachers hear the students reflecting back to them in this communication, that this is the value that they will be gaining, then we know that students have a kind of motivation to benefit from this assignment.

John:One other issue is that students have come up with some way of learning while they’ve been in elementary and secondary school. But those methods that they picked up are not generally the ones that are most effective. How can we encourage students to adopt learning strategies that they may be resistant to because for example, students, when there have been surveys of what types of learning strategies they found most productive, students often say they prefer to be lectured at, because they learn more from the professor that way. And also, many students don’t like active learning strategies. While they learn more, they don’t perceive it that way. Partly because of those desirable difficulties you referred to before, that when they’re struggling with something, it’s a little bit less pleasant than sitting there nodding and smiling and having everything seem to make sense. How can we encourage students to accept those desirable difficulties associated with learning so that they can learn more effectively,

Mary-Ann: I want to say that this is something that the TILT framework can definitely help us with. And this is not an uncommon phenomenon at all, I even find in my TILT workshops that I do with instructors, that instructors don’t love collaborative learning either. And in fact, many of these TILT workshops that I do will begin with some kind of a research review about “How do we know TILT works? What are the studies and what do they tell us and show us the data?” So we get off on this kind of role, where we’re almost in a traditional lecture format, where like someone’s delivering some information, and people are listening, and then they have questions about it. Or maybe they have challenges to say, “Wait, this doesn’t make sense, let’s talk about this.” And then I kind of switch the method that we’re using. And I’ll ask people to break off into small groups and begin to analyze a particular assignment and talk about where do they see the purposes, the tasks, and the criteria? Before I do that, I acknowledge the fact that we are shifting gears, and that we were doing fine with this sort of Q&A format. You know, look at the research and then think about it and talk about it. Ask questions. Why would I switch that up now? Like we were on a roll, we were doing great. Everybody was sort of on board. Why would I change that now? And so I use the TILT framework to talk about why we’re shifting gears now. What is my purpose in having you use this different method? So if it’s a peer learning method, as it is in the workshops, or as it might be with students in a class, we want to tell students: “Why are we now manipulating your learning experiences this way? Why would I do that to you when I know that sometimes students resist this, when I know that it can be uncomfortable, because I don’t personally always like to do it when I’m in a learning experience?” So if we can tell students, here’s why this is going to benefit you, because you don’t just hear it, but you have to struggle to apply it, you have to fit it not to the situation that I was talking about, where it all sort of makes sense when it rolls over you and you’re hearing it. But you now have to take the principle of what we were talking about, and apply it to this new unfamiliar scenario. And the benefit of that is that you will discover you will hit a barrier at some point in that process, where you will discover the exact piece of information that’s missing for you. You will discover exactly where you hit a barrier to your understanding. And you will have an opportunity right now, right here with me, the teacher in this class, to address that confusing point. And the benefit of doing that now, as opposed to later when you’re doing a graded assignment, is pretty obvious, you get the benefit of having the difficult learning experience in a safe environment that doesn’t lose you any sort of points on your grade. It doesn’t have any negative impact on you the way that it might if you waited until the end of the term to do some massive project and you hadn’t really done a lot of the homework or done a lot of the practices and so you didn’t really know what you didn’t understand until it was kind of too late to do anything about. So I think in short, what I’m trying to say is when we’re asking students to do something uncomfortable, that has a really solid pedagogical reason, that has evidence behind that, it is an evidence-based practice, we want students to know that upfront, because that then will increase their motivation to do it, because they see how they’re going to benefit if they do this thing.

Rebecca: One of the things that students often struggle with is when they start new courses with new faculty, and new ways of doing things and determining what the instructor will expect out of them and out of that learning experience. Can you talk a little bit about how the TILT framework could allow students to shift their focus to learning if it was adopted in the design of the course rather than just an individual single assignments?

Mary-Ann: Yes. And in fact, this is a way that lots of faculty are using the TILT framework, is to think about how do I TILT not just a single assignment, but a whole course. So usually, when people are introduced to the TILT framework, the original ask for all our research studies is would you please do this two times in an academic term, just twice? Because we wanted to see how little change could you make and have a beneficial impact on students’ learning, because small change is much more likely to happen than massive change. But once you’ve made that small change as an instructor, and you see that when you do this with two assignments, there’s some real benefit for students. And on the TILThighered.com website, there are publications by faculty who talk about not just how the quality of students’ work increases, but how the teachers experience in grading, or in responding to students, or in how many students will ask for an extension at the last minute, like these difficulties that teachers often face are diminished, while the benefits for students and the quality of students work increases. So once you begin to see this in the small scale of assignments, teachers then, maybe in the subsequent term, will think about what else could I TILT? Could I TILT in-class activities? Could I TILT a unit of this course? Could I TILT the whole course? And then the effects or the applications can grow. So we can apply this to a single assignment, we could TILT a whole course, we could TILT a curriculum in a department, we could TILT a program, we could TILT an institution’s learning outcomes and thread them through not just all the courses, but through all the co-curriculars too so that students might discover in their work-study job that they’re practicing one of the critical thinking outcomes, that’s a goal for the whole university that connects with what they were doing in their accounting class. And then we can even think about this in terms of a national framework of learning outcomes as well. So there are many scales at which you can apply that to a framework. And one of the things that I’m really enjoying about doing TILT full time, is that I can work with groups of schools, groups of institutions, so not just the Washington State group that I mentioned to you, but several weeks ago I was in the state of Kentucky where working with teams of teachers from institutions across the state, for the whole state system, to think about aspects of how do you map out a path for students to succeed in fulfilling their curriculum? And then how do you pursue that path? How do you complete that path? And in that case, we were using the TILT framework as a strategic planning framework to think about once we know what the plan is, like, once we’ve mapped out our plan for how students can effectively complete their degrees, how do we then communicate the value of that degree, not just to the students who are doing the degree, not just to the students’ families who may be contributing to the costs of doing that degree, not just the costs of the student’s tuition, but the cost of the student not being an earner in that family. And we want to communicate this to all the stakeholders, so the students, their parents, faculty, and staff at the institution, to state legislators who may be voting on packages of funding to higher education in their state, to individual grantors who might be funding particular scholarships. And we want to be able to communicate the value of this degree to every stakeholder in a state system that way. And the TILT framework is very helpful for thinking across multiple audiences, because that’s a pretty difficult task to communicate clearly to all of those different kinds of audiences. But it’s pretty essential for the success of higher education in this country. And so we spent a couple of days using the TILT framework as a strategic planning framework to think about how do you communicate the value of a degree? There are lots of ways that you can apply the TILT framework. Another example is I was working with a school in Texas over the summer, and they were TILTing their entire college success course. Many institutions have that kind of course in the first year, and some of them had TILTed individual assignments. And they decided they wanted to put the team of all the teachers together, and then subdivide that so that a smaller team of teachers was working on each week of the course. And then all the assignments and the lectures or discussions that would go into that week. And then we use the TILT framework as a larger framework to connect that whole course. So that from week to week, the purposes, tasks, and criteria were pretty clear. And students understood the path for all of their learning across that course.

John:Have you tried taking on the Florida Legislature? [LAUGHTER]

Mary-Ann: I have not.

John:That’s a real challenge, I suspect.

Mary-Ann: Yeah, I have worked with schools in Wisconsin. Last week, I was working with a school in Tennessee, right after a couple of their legislators were expelled temporarily. This kind of a framework, I think, can be effective in a lot of different higher education systems and contexts. That’s one of the beauties of it. Because this is something that teachers can do, starting right now, to complement any kind of larger, institutionally driven or federally funded program that might focus on student success. A lot of the time, those programs don’t necessarily feel like they’re directly connected to what faculty members are doing in the day to day in their classes. But using this TILT framework is something that you can do that will advance students’ success that will then make you feel more like you’re connected to these larger ongoing efforts that might be focusing on something that you don’t do directly, like targeted scholarship funding, for example. But that’s part of the beauty of the TILT framework is that it can work in many, many different contexts, and across different scale sizes of projects, as well.

John:And it works nicely for faculty because you end up getting work of the quality and the type that you expect, rather than getting student work that you find disappointing. And similarly, students end up doing work that they’re much more happy with, because they were not guessing at what the instructors want. So it just seems really, really logical. But it’s not always so widely practiced. Your efforts are really helpful for all of this.

Mary-Ann: I think one of the reasons why people might be hesitant to use the TILT framework, you don’t necessarily want to try doing something different that could suck up time that could take time away from delivering important content in the course, and what teachers have discovered and written about and published in the National Teaching and Learning Forum and other places you can see on the TILThighered.com website, what teachers have discovered is that if you take some class time to talk about the purposes, tasks, and criteria for a project before students do it, by the time that practice is completed, everyone has saved time; that time gets recouped, and students have learned a larger quantity of what we had hoped they we’d learn because when we deliver content in a course, we don’t know that students are absorbing it the way that we’d hoped or that they could apply it the way that we’d hoped. So I think by the end of the course, if you’ve used the TILT framework a couple of times, you’re in a situation where you’ve worked in a way that is more time efficient, somewhat, and you arrive at a place that, as you say, is more satisfying for students and teachers, because more of the time has been spent with the students doing the highest quality work possible.

Rebecca: I think one of the things that can be challenging for faculty initially is that if you’ve never communicated in this way, it’s hard to do it the first time, because anything you do the first time is difficult. But once you have a little practice doing it, it’s easy to adopt and expand across a course or across a set of courses.

Mary-Ann: That’s so true. And I think that the way that we’ve structured the TILT framework, it looks so simple, it’s a three-part framework. Applying it then gets you into some complexities that are important to clarify. I think you’re absolutely right, the first time we try anything that’s unfamiliar, just like for students, it’s more difficult. And then we kind of get the hang of it. And then it comes much smoother, and much easier. The TILT framework for starters, is pretty simple. It’s got three parts, right? And I think you could probably share a link to the one-page version of the framework that we give to students, that sort of spells out the framework: purpose, tasks, criteria, the knowledge and the skills. And then at the bottom, there are some of the evidence behind why we know this works and some footnotes, so that students can see on one page, this is a real thing. It works, it helps you. It is, in some cases, equitable, and it is probably worth giving it a try. And if you can see all that on one page as a student, then you might be more willing, especially in a context where a teacher is describing to you why this will be good for you, why this is a benefit for all of us. And then for teachers who have not encountered the TILT framework, when students can bring in this one pager that has some studies listed at the bottom and footnotes, they can see that when the student is asking me, why should I bother? This is actually a legitimate question. This is not a troublemaker student, this is a student who actually knows that they will benefit from knowing a little bit more in advance about this assignment that they’re planning to do. So we try to make it as easy as possible to implement. And then we also try to say only a little bit of this will make a statistically significant difference for students’ learning, so that you only have to try it a couple of times in a whole term. And you’ll probably see the kind of differences that we saw in terms of increases to students’ confidence and their sense of belonging, and their metacognitive awareness of the skills that they were practicing and developing. So if you’re doing anything new or different for the first time, yes, there’s some difficulty to that, but this one is a very, very desirable difficulty. [LAUGHTER]

John:We’ll share a link to that one-sheet document as well as to your website in general. And you do have a lot of research cited on your website. And there’s also some ongoing projects. Could you talk a little bit about those?

Mary-Ann: Yes, we are sharing all the resources that we possibly can on the TILT higher ed website, because we want for everyone to have access to this. Some of the places that benefit most are places that might have the least amount of money that is allocated for faculty development or educational development. So we want to make sure that this is accessible to anyone who would want to try it. And then the studies that we’ve done in the past, there are a few studies that have indicated to us a number of the benefits of TILT. One of the first studies we did was the national study we ran with the Association of American Colleges and Universities. It was funded by TG Philanthropy and my colleagues working on that project were Tia Brown McNair and Ashley Finley. And what we did there was we worked with a group of seven minority-serving institutions from across the country that represented every possible type of minority-serving institution, as well as a range of educational contexts like urban and rural, two-year, four-year, research university, really small in scale, large, residential and non residential campuses because we wanted for teachers to look at our results and see, “Oh, well, this worked for those faculty at that institution, and there are students like my students in that mix, so maybe this would work for my students. And in that study, we started with 35 professors at seven schools and we surveyed about 1200 students and we saw that, for the students who received the more transparent instruction, their competence and their sense of belonging and their metacognitive awareness of the skills that they were developing, those increased, those were higher for the students who got more transparent instruction than for those who got less transparent instruction. And then we also saw in that study some differences that showed us that while all the students were benefiting to a statistically significant level, underserved students were benefitting slightly more. So first-generation students in their family to attend college and ethnically underrepresented students and low-income students have slightly larger benefits than the benefits for the whole group. And then in our second study, we focused on how long does this effect last. So we worked with a group of University of Nevada – Las Vegas students. At the time we were working with that study, University of Nevada – Las Vegas had the most diverse undergraduate student population in the nation, according to US News and World Report. And we know from other studies, like Walton and Cohen’s, 2011, Science Magazine article, for example, we know that when students’ confidence increases, when their sense of belonging increases, they tend to persist longer in a course. So in courses that have higher levels of confidence and belonging, fewer of the students would drop the course, for example, more of them more likely to complete the course. And we wanted to see how long does that last. Is it just that course? And some studies indicate that this could last for a year. And what we did was we kept looking at the retention rates of these students to see how many of them were still registered a semester later, a year later, two years later. And we saw that by the time students were in their third year of university as undergraduates, those students who had received transparent instruction in one of their large gateway intro courses in their first year, those students were a little bit more likely to be still registered as students in their third year. And we’re now tracking that out to six-year graduation rates. So we saw that not only does transparency have a beneficial effect, it’s statistically significant, but that effect lasts for a good long time. And then in the state of Washington, we’re now writing up that study I mentioned with the Community and Technical College System. And I think that TILT is particularly helpful in that environment, because the population of community colleges and technical colleges is a little bit more diverse. And we have more students who belong to that underserved category of students, first-generation, low income, ethnically underrepresented. And what we’re finding from that study is we’re understanding a little more about how does transparency work, and I want to thank all of the researchers who are contributing to all of these studies too, because I’m not an educational statistician, so Daniel Richard, and Carolyn Weisz and Kathryn Oleson are contributing to this study and doing a lot of the analysis, along with help from some graduate students who have been working on this project over the years. What they’re discovering is that transparent instruction has a direct impact on students’ awareness of the skills that they’re learning, and it has a direct impact, similarly beneficial, on students’ sense of belonging. And then separately, sense of belonging has a direct impact on students’ metacognitive awareness and skills that they’re developing. So TILT has this direct effect. And then there’s this other effect between belonging and skill development as well. So we’re finding out more about precisely how TILT works for the benefit of students in these studies. And I think in terms of next studies, I want to be asking questions that really matter to populations of faculty and students around the country. So we open up the TILT research team to anybody who’s curious about this, and a number of faculty have asked about, can we say something more about how this works in an online setting, in an online synchronous setting in an online asynchronous setting, and we’ve got a few publications up on the website about that, but others are looking at that a bit more. And then we have another person who’s looking into just the impact on low-income students to see if we can find out more there about the details of how this works. And I’m really curious to see if we can work with large state systems, what can we find about the most time efficient, most beneficial ways to apply transparency and learning and teaching in community college settings. And I’ve also noticed that as I begin to do more work internationally, because I now have more flexible time to be able to do that, the colleges of applied sciences, like in the European Union, for example, they have a kind of three-year degree that is similarly focused on students’ learning something from their degree like they do here in a community or technical college that will lead them on a path into sustainable long-term employment and a career. So I think that this is going to be a really beneficial place to focus TILT efforts and to do some more research about how can we long term have an impact on not just students’ education, but how that is a pathway into a career. And I’m hopeful that we can find out more about that, like the longer long-term effect of TILT. But I’m also really open to inviting anyone who wants to do more research with the mountains of data that we’re sitting on, to discover something that is of interest to them about how students are learning, and how we can help students succeed more.

Rebecca: I really love all the resources and examples and research materials, worksheets, that are on the website. They’re really handy for folks who are starting out. We always wrap up by asking: “What’s next?”

Mary-Ann: What’s next for me, and then what might be next for teachers and students too. So we’ve talked a lot in detail about how TILT works, and how we know it works, and what more we want to discover about how it works. But I want people to remember that this is really a small effort, it’s a very easy lift that has a really large benefit from the size of that lift. And so I would really encourage teachers and students, if they’re going to do anything at all, even if they have no time to adjust any assignment prompts or to adjust anything about the way that they’re teaching or learning in a classroom. If you use any one single thing, I would say use that framework that we built for the students that has the footnotes at the bottom, and it’s called the “unwritten rules” and that framework, and I think you could probably provide a link to it, that’s what I would hope people would do next, just take that framework with you to anywhere that you’re communicating with your students. And the students will tell you how to make the work more transparent for them. Ask students what they see as the purpose, the task, and the criteria. And you’ll discover very quickly, very efficiently, how you can make that work more transparent so that all students are starting to do the work with the same understanding about what’s expected and with the same set of resources that they need in order to do it. So that’s what I hope is next for teachers and students.

Rebecca: And I hear all the faculty cheering about efficiency, and quick. [LAUGHTER]

Mary-Ann: That’s good. Yeah. So that would be the most time efficient thing to do, I think is to have students teach us more about how to be more transparent. And then in terms of researchers, I’m hoping that researchers will think about what can we learn more about? Can we learn more about what motivates students? Or what forms students’ sense of belonging? Is there anything in our survey data that would shed light on any kind of work you’re doing around that? Is there anything in our survey data that would shed light on more of the research on neuroscience and how that’s impacting learning? Or is there anything in the research that we have in our survey data that might help clarify what would be most beneficial for the very most at-risk students? So if we look at federal government statistics, National Center for Education Statistics about retention rates and graduation rates of different populations of students? Can we double down and look at those students with the very lowest graduation rates? And can we find something about TILT that would be the most beneficial for that population of students? To me, that’s a really important and interesting question. And then I really do want to be finding more locations where TILT could be useful, small scale for teachers and students, large scale for state systems or national systems to be thinking about how to apply this all for the good of students success, and for the satisfaction and time efficiency for teachers work as well.

John:If you’re finding these results of long-term persistent effects from just a single intro course, imagine what would happen if all intro courses use the TILT approach. I imagine the effect would be magnified if it was adopted at a broader level and it is being adopted at many institutions at a broader level.

Mary-Ann: I absolutely agree with you that applying TILT across the largest introductory gateway required courses at any institution would be probably the most efficient way to improve retention and graduation rates. Because if you go for the largest group of students as they enter, and you reduce the number of those students who might be thinking or doubting or wondering if they should continue, and if you increase the number of students who feel confident, who are aware of the value of what they’re learning, in terms of skills and knowledge, and if you increase the number of students who persist from the first year on, then that’s where you’re going to have the best success in increasing retention and graduation rates. I agree with you. I think that’s a really strategically wise place to invest TILT effort.

Rebecca: Well thank you so much. We’re looking forward to sharing this with our listeners.

Mary-Ann: And thank you so much for the opportunity to talk with you this afternoon, I really appreciate it

John:Thank you for all the work you’re doing.

[MUSIC]

John:If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

275. Improving Learning and Mental Health

 Student reports of mental health challenges have been rising rapidly for several years. In this episode, Robert Eaton and Bonnie Moon join us to discuss what faculty can do to better support students facing these challenges. Robert and Bonnie aretwo of the authors of Improving Learning and Mental Health in the College Classroom, which will be released later this spring by West Virginia University Press.

After completing a law degree at Stanford and working for several years as a litigator and general counsel, Robert returned to academia in 2004 as a member of the Religious Education faculty at BYU-Idaho. He is currently a professor of religious education and a learning and teaching fellow, and has previously served as the Associate Academic Vice President for Academic Development at BYU-Idaho. Bonnie is a member of the math department at BYU-Idaho, where she also serves as STEM Outreach Coordinator.

Shownotes

Transcript

John: Student reports of mental health challenges have been rising rapidly for several years. In this episode, we discuss what faculty can do to better support students facing these challenges.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Robert Eaton and Bonnie Moon. They are two of the authors of Improving Learning and Mental Health in the College Classroom, which will be released later this spring by West Virginia University Press. After completing a law degree at Stanford and working for several years as a litigator and general counsel, Robert returned to academia in 2004 as a member of the Religious Education faculty at BYU-Idaho. He is currently a professor of religious education and a learning and teaching fellow, and has previously served as the Associate Academic Vice President for Academic Development at BYU-Idaho. Bonnie is a member of the math department at BYU-Idaho, where she also serves as STEM Outreach Coordinator. Welcome Robert and Bonnie.

Robert: Good to be here.

Bonnie: Thank you.

John: Our teas today are: …are either of you drinking tea?

Bonnie: [LAUGHTER] I brought my lemon water. Can I still be on your show? [LAUGHTER]

Rebecca: Well, they are two key ingredients of tea.

Bonnie: Yes, right. That’s what I thought.

Robert: And I brought my favorite flavorful herbal tea. Sweet and Spicy Original from Good Earth.

Rebecca: That sounds good. I’m sporting the Hunan jig again, John. That’s all I got. [LAUGHTER]

John: And I have a ginger peach green tea today.

Bonnie: Oh, that sounds delicious, too.

John: We’ve invited you here to discuss Improving Learning and Mental Health in the College Classroom. Could you tell us a little bit about how this project came about?

Robert: It actually started with me. And it’s hard for me to trace exactly when it started. But I’ve been out of the classroom on a full-time basis for a while. And when I got back in, I was amazed to see just how many students were flaming out and fizzling out by the end of the semester because of mental health challenges. And I’d sensed that this was an issue of increasing severity, but still seeing it firsthand, especially after a few years away, was really breathtaking, and got me thinking about the way that we teach and our course design decisions and what effects that might have on students and whether there were things that we as professors could do. So I ended up kicking off a semester-long faculty learning community exercise, we call them a “Think Shop” here and Bonnie was one of the members of that group. And I thought I wanted to tackle a book, and eventually as we got into it, I invited Steve Hunsaker, who’s not with us today and Bonnie to join us. And it’s been a marvelous collaborative effort.

Rebecca: Can you talk a little bit about who your target audience for the book is?

Bonnie: College professors, somebody like me, who didn’t come from a background heavy in psychology or understanding the psyche and to someone that loves mathematics… someone like me, who doesn’t really understand all of the details, but wants her students to feel safe in her classroom and have a safe place to study and to thrive and to be passionate about something. And so, yeah, so college professors, research or at our Institute, we focus on teaching but either kind of Institute.

Robert: So that said, our research assistant has now graduated and is teaching elementary school, and said she uses many of the ideas from the book. And they’ve been relevant even in a K-12 setting. I was thinking through how we probably, from a marketing standpoint, didn’t choose wisely enough… that really many of the ideas in the book would be beneficial to a student, even if their teachers choose not to do any of these things, they could still realize, “Wow, community matters, maybe I should try to connect with some people and create a study group, even if the teacher doesn’t facilitate that.” So I would say college students with mental health challenges and their parents might benefit from it as well,

Rebecca: When we’re running professional development, which is just another setting of teaching, those students might also fit some of these descriptions, too. [LAUGHTER]

John: Could you tell us a little bit more about that faculty learning community that this work began to grow out of?

Robert: A few years ago, we’d started a formalized faculty learning community exercise, we branded ours a “Think Shop,” but basically, it’s a semester-long effort where faculty from different disciplines come together and take a deep dive into the scholarship of learning and teaching or something that affects teaching and we exchange ideas. So we met every week, we each read different things, and I kind of facilitated that and led a discussion. So it was delightful to get to know colleagues better and to brainstorm and benefit from the different disciplinary perspectives. Bonnie, would you add anything to that?

Bonnie:Yeah, I am so grateful that I found that community. Not only are we hopeful that we’ll create a place where students can thrive, but I think it’s important for the professors that run these classes to also model this and to participate in these things. So having that community with other colleagues, especially right at the start at COVID, [LAUGHTER] was very helpful to me and my mental health. And it was just invigorating to learn new things and understand a whole new discipline that I had never studied before and to try and understand what’s happening. So I think it was an opportunity for me just to even model when I’m hoping that my students will do as well.

Robert: It turns out community is not just good for students from a mental health standpoint, but for faculty. For us, the timing was fortuitous, it came right on the front end of the pandemic. So at the time when people were kind of having to withdraw socially we continued it virtually, and it gave us some great community support.

Rebecca: It’s probably worth noting that you just mentioned that this conversation started prior to the pandemic. Certainly, our awareness around mental health issues have been raised and related to the pandemic, but these were growing issues among college students prior to the pandemic, for sure. Can you talk a little bit about why we’re seeing these mental health challenges so prevalent among college students?

Robert: It may be a cop out that we took in the book. But we basically said, what are the root causes of this? We’re not really sure, but we know they’re arriving, and that the problems are real. In fact, one of my fears, sometimes, with the conversations among some of our more hard nosed colleagues, when we talk about roots is that I feel they’re a bit dismissive of the symptoms, and think, well, people just sort of buck up, and if they’d put away their cell phones and move some pipe and work like we used to everything would be fine. I’m fascinated by the debates. And in fact, there was one item, we were going to include in Bonnie’’s chapter, and then a meta analysis came out that was contrary to the other studies that I’ve been seeing. And so we left it out. So I’m puzzled, intrigued, and have my own guesses. It’s hard to ignore technology and the way it’s changed society. So that’s certainly a controversial but leading candidate, but something has changed. There’s a little bit of people being more willing to go and get diagnosed, and maybe a little bit of change of measurement. But there’s some pretty good solid measurements, like attempted suicides or self harm, where it’s not just categorization, where we can see this is really snowballing over time. So our short answer is, we’re not really sure. But we know they’re coming to us with these problems, we are rooting for those people researching the root causes. And we’re kind of leaving that to others as we deal with the symptoms that we see in our classrooms.

John: We’ve always lost a lot of students along the way. And some of that seems to be related to the stress and anxiety that students experience. You describe in your book, the high-risk, high-stakes, environment of college. Why would that tend to increase the prevalence of mental health challenges for students?

Bonnie: So first of all, they’re just coming from maybe a secure place, high school, a place where their teachers were there, they knew them every day, they were very structured, and they knew their schedules, and then they’re coming to this new place to navigate. And it’s a whole new world. And so they’re on their own, their support system is not necessarily in place as they come into this new world. And it’s just like we said in the book about this petri dish just ready [LAUGHTER] for something to happen that does not seem normal or good. And so I think that the uncertain times of it, the deadlines that we put on them, maybe sometimes just not even having a friend. Some of these kids get isolated in their rooms, and they don’t see people for days, and then the teachers start to hopefully miss them. And I think that is part of where we can make a difference. And we were probably going to talk about this later, but when you think about the college experience, the teacher, the professor, is the one that has the most likelihood of seeing these students most often and most regularly, and when we don’t see them. I’m hoping that we’re alarmed. And like, “Where have they been for a week or two weeks or three weeks?” One day, I was in class, and I noticed one of my groups was conversing and that one of the students was really struggling to socially interact with these other kids. And he was just upset and mad. And the other three students were very uncomfortable working with him. And so I started to wonder what was going on. And I made a few phone calls, and one of the students asked me to please call the services on campus… I’m not sure what they were called back then, we’ve been working on this at our campus to get these services more upfront… but I think I ended up calling security because the kids were so worried about this kid, that he was going to be violent, that I ended up calling security. And so security actually had a program where they reached out to him, they went to look for him at his home. And the sad thing is that this kid never showed up to my class again. And so after that experience, I was like “What happened?” like do inform us of things going on. And I found out later on that he had passed away, and there was no details, there was nothing. And as a professor, I was like, “What could I have done?” I didn’t understand, I knew something was kind of strange, but I just didn’t understand, I didn’t have the tools, and it’s not our job to fix these things. But to be able to recognize something in our classes and get these students to places where they can get help. I think that’s something we can do, and it doesn’t go too far outside of the reach of our classroom. We’re trying to build curriculum, we’re trying to build awesome experiences that motivate students. A lot of us might say, we don’t have time for this when I have time to worry about the students outside of our classes. But it would have taken just a couple phone calls, and I know they did reach out. But I don’t know, I don’t know what happened to that student. But still, I feel like I can do something. Even if it’s small I can do something for one person. It matters.

Rebecca: I think the reality is that we often say we don’t have time yet we expend a lot of energy actually worrying about our students, or at least a good portion of faculty do, because they are missing or something seems not quite right and we don’t know what to do. So that energy is being expended whether or not we’re actually acting on it.

Robert: Yeah, in fact, I think there are a couple of false dichotomies to be aware of: one is I either do the stuff I’m supposed to do as a professor or I babysit kids with mental health challenges, or I either focus on being a high expectations professor who really helps students master the content or I just coddle them. And we find those both to be false narratives. For example, I now on the first day of class do things differently than I did the first 10 years. And I have students in teams, I make sure at least one person in the team has already read the syllabus, maybe taking the syllabus quiz, and then I have them show each other. First, I have them connect, get to know each other, share phone numbers, and then I have them show each other all the stuff. And once they’re all done, then I say, “Have you got any questions?” And there are usually relatively few. The dynamic on that first day is fundamentally different and better than it used to be and I get far fewer follow up emails and phone calls asking how to do something because they text each other, they know how to do it. So it’s a simple technique, that’s actually a great one, for helping our students who come to our classroom with some anxiety and wondering if they’re gonna have any help or be able to make any friends. And it actually takes me less time in the course of the next couple of weeks because of the fruitfulness of that investment.

Bonnie: Yeah, what if we could be better teachers, and help our students improve their mental wellness at the same time, and it didn’t take any extra time? Wouldn’t you want that recipe?

Robert: In fact, that’s why we went back and forth on the title, we really struggled. But we wanted to convey the notion that you don’t have to choose between improving learning and mental health, that really virtually every tactic we recommend in the book, we would recommend even to someone who somehow had no students with mental health challenges in their classroom. It just makes for better learning, they happen to also make life much better for students with mental health challenges.

John: One of the really nice things that I observed in reading through your book is that so many of the practices, as you said, are things that are recommended by people who study effective learning techniques. And one of the things you talk about is replacing high stakes exams with lower stakes activities. Could you talk a little bit about that?

Bonnie: Given a little bit away, I’ve been a student myself for the last two years. I took a sabbatical and went back to school. [LAUGHTER]

Robert: And what degree are you pursuing, Bonnie?

Bonnie: And so I love mathematics, but I wanted to see how math works inside of a nuclear reactor, so I went back to school in nuclear engineering. And so, [LAUGHTER] just coming fresh off of that, and having worked on this project with Robin, Steve, I’m like, ”oh, I have so many ideas for you guys about how you could help me not be so stressed out, and not so anxious today.” [LAUGHTER] They didn’t want to hear that. But I was like, “I have some ideas.” But one thing I think that I’m taking back to my classroom from that experience is choice. Like when my professors gave me choice, and they let me follow a path that I was passionate about, I was all in, I didn’t have to be pushed, I was pulled into that direction. And so when I think about assessment in my own classes now, like coming back, and I think about that final exam, and sometimes that is a high-stakes place, and very stressful, even all of our exams can be that way. So for my differential equations course this semester, and I have done this a few times before, I give a choice, of course, between a final exam or final project. And we start talking about this early on. And not all of them want the final project because it is a lot of work. But watching them light up, and to see that they could do something different than sit down and take a test for three hours.[LAUGHTER] It’s just so heartwarming to watch them, and it’s helpful to them. And I was telling Rob and Steve that I had one student that took the project and found something to do inside of his other classes he was taking, and he kind of connected them together. And to watch his passion and to see him come from the student that sat in the back row that seemed mad every day, [LAUGHTER] and when I mentioned this final project, he just lit up and I could see hope, and at the end of the semester, he couldn’t stop. Like I finally said, “You can get some sleep tonight, you don’t need to work on this every minute of the day.” It was just an amazing transformation to see purpose, help him come pull out of this. I don’t know if he was suffering from depression, but he was definitely down a lot in my class, and maybe that was the subject because mathematics tends to make people anxious sometimes anyway, [LAUGHTER] but just to see the turnaround. So I mean, I don’t know that we always have to put everything in one place, but we can give choice and let them kind of have some room to navigate their own way through our courses.

Robert: I should confess that I started from a pretty old school hard-nosed mentality. And that law school, it was a game I played well, so I thought it was a good game. And the in-class instruction, by the way, at my law school was fabulous. I still think that. But the course design, now I look back on that and I think a single assessment that’s three hours long at the end of the semester, and your feedback is one number. So I might have understood a few concepts really well and others really poorly. I actually have no idea. And for that matter, the professor has no idea how well the class is understanding things until she grades the final. She doesn’t have a chance to correct. If I were redesigning law schools, I’d say break it up into four tests. And then make it comprehensive. Give students the opportunity and incentive to fill in their knowledge gaps that they identify on an initial test or assignment. I’m just so embarrassed to admit that that, until I really studied for this and dug in and researched, really didn’t cross my mind. What happens when I give a test to students and many of them bomb it and we just move on. What am I hoping that they’ll learn? …to work harder for their next test? Well if those concepts were really as important and foundational as I claimed they were, I should be more concerned about finding a way to encourage students to go back, fill in those knowledge gaps. And so now I’ve softened up and I give them opportunity and credit, I still give them incentive to try to learn it right the first time, but I’d like to give them some incentive to go back and learn things they crashed and burned on the first time around so that they don’t get left behind.

Rebecca: You mentioned at the start of the conversation that there’s symptoms that we see, we don’t necessarily know the root causes, but we’re seeing the symptoms of various mental health challenges. And those symptoms impact student learning. So there’s a consequence to that. If we’re having anxiety, then we might be presenting that in a particular way. And then that’s probably impacting how learning is happening for us. Can you talk a little bit about what that looks like? And then we can follow up with “How do we support students who are facing those challenges?”

Bonnie: I think, especially in my math classrooms, I see a lot of stress, anxiety, and the way that I saw it this last week… I’ll just tell you that example. So we were talking about filling in the learning gaps. I do a little bit of just-in-time review so that my students get prepared for class because I understand that when there are those learning gaps, it can be very intimidating to come back to a class and try and start over again. But then as you start to see their stress… and today, the student just started to get angry at something that was going on in my class. And I was like, “What are you talking about?” He said, “Well, my last class, we got to use technology, and we got to do all these things.” And I’m like, “That’s okay.” [LAUGHTER] So I could see that he was stressing out. And he may even have… I don’t know… this was just the symptom, I think, of a deeper identity with him. Like he didn’t identify with math, he didn’t see this math, he saw this as something that he just needed to get through, and stressed people don’t do math very well. [LAUGHTER] And that might be true for other subjects as well. But some of the research I dived into showed that when you’re stressing out and the teacher is coming down on you that you can’t do math, so what are we doing in our classrooms? So I started to rethink things today and said, “What is the root cause of this? What is he really stressing out about?” And that was just a one time thing. But I think maybe you’re asking more about how we identify kids, it’s just not stress, but when they start getting depressed, and when they start having this anxiety. I mean, these are things I think sometimes that are harder to see, unless you’ve been there, or you had experience with that. So one thing that I will share with you is that when I had a situational depression, that was triggered really quickly, I was not prepared for it, I started to withdraw. And I started to come away from my life. And so I can recognize that more easily now, when students start to withdraw from their groups, communicating, or they start to miss class for two or three days in a row. Or they communicate in ways that you really aren’t socially kind, like sometimes they get mad. It’s not just madness, but sometimes they just become very withdrawn and apathetic. I mean, those things are normal for everyday. But if it continues for like two weeks or three weeks, then I start to say this student might be suffering from something that’s depressive or possibly anxiety. So I do look for things like that.

Robert: Let me just add to your question, Rebecca, anxiety, or stress can be a bit like the bull and pit. It can be advantageous sometimes. it can save our lives, when some adrenaline is needed, but in certain situations, and for certain people. In fact, it seems to affect different people differently. It’s very unhelpful in the learning process. So the consensus of the research that we saw suggested that maybe in short, occasional doses, it can be fruitful, but chronic and high doses, stress almost always interferes with the learning process. And then depression, it was just always bad, [LAUGHTER] we just couldn’t find anything saying this was ever helpful to the learning process. And there’s a bunch of physiological explanations for it. But, in fact, one thing to remember is, some of us do well, like I speak better, with some stress than without it. And so those of us who succeed in teaching as careers are probably people who dealt well with that anxiety and stress built into college. And it may make it difficult for us to understand and empathize with students who process that differently. And it may cause us to be just a little callous and say, “Yep, college is stressful, buck up.” But it’s helpful if I then think about how I sing a solo. I sing much worse than I sing in a duet or a quartet. And in practice, I sing better every time than I do in a public performance. [LAUGHTER] So in that area, I can see: “Wow, stress really undermines my performance.” So it’s just a matter of being mindful of how these mental health challenges, generally, when there’s too much of them and they last too long, almost always interfere with learning.

John: What can faculty do to try to create a more supportive but positive environment for the students, which will reduce extreme levels of stress and reduce anxiety which can interfere with learning?

Bonnie: So this is where I’ve been working,[LAUGHTER] coming back from my sabbatical and seeing and feeling the stress. I want to be more aware. And so some of the things that we researched and looked into, I’m starting to use more regularly in my classes. And so one thing for sure, and we hear this a lot, just as a regular teaching strategy is to learn their names as soon as possible when they know that somebody knows them, and somebody understands that they’re not there or they are there, it makes a difference. So this is our first week of school, and so I have put a lot of energy this week into taking those names home and learning their names. And I have an every day classes, this is day three in that class, and just being able to go up to them today and talk to them, ask them their name, their major, and even before class, I’m there trying to understand who they are, a little bit about their background. And so it’s important to me, it’s important to me when I was a student, that they knew my name, and that they knew I was Bonnie Moon, and that this was what my dream is and I’m hopeful that this will happen. And so I think that’s one specific thing that we can do. I realize that some teachers and professors have these huge classrooms [LAUGHTER] with 500 students. So, we’re very lucky here because we have classes between 30 and 50. And so we can learn their names in a couple of weeks if we work hard at it. So I’m very intentional at that at this point.

Robert: I’ll add another just in terms of messaging, we found when we did focus groups that students had had a variety of experiences with professors. So they were looking to read us, they’re looking to see what does this professor really think about my situation and do I dare go ask for a bit of flexibility if a mental health crisis arises. So I added two paragraphs to my syllabus, and I have yet to have anybody I felt like was trying to exploit it or take undue advantage of it. And I’ve had other students thank me who I had no idea had mental health challenges, and they didn’t have to use it. But they said, just knowing that I felt this way, put them at ease. I have this section on mental health challenges:

A growing number of students experience mental health challenges to varying degrees. Doing what you can to stay ahead and on top of depression or anxiety by wisely taking care of yourself will be a key to succeeding academically. But even then, sometimes these challenges can affect your ability to complete the required work. Or a particular assignment might trigger anxiety for you in ways that I’ve not anticipated. Or maybe you reach a point where you just can’t get yourself to class at all. In any of those cases, please come and talk with me, or at least send me an email. I’ll listen and do what I can to help. But the sooner you share your challenges with me, the more I can help. To learn the material and pass the course or earn an A you’ll still need to do every bit as much work as other students…

By the way, as an aside, all the students in our focus groups were not only fine with that, they wanted that. They didn’t want us just to write off assignments that they missed from two weeks that they were in bed with severe depression, continuing:

…but we may be able to find some creative ways to help you do that, especially if you approach me when your problems arise, instead of at the end of the semester.

I think I get a lot more students now willing to come in, my having made it safe through this provision, and let me know about their problems while they’re still in progress and we can still do something about it. Before I was getting a lot more coming in the last week, who were in a hole that was just so deep, I couldn’t, in good conscience, find a way for them to get a passing grade.

Rebecca: So the key is catching them before they disappear.

Robert: Yeah, I think doing some preventive things. So being proactive. We found some interesting studies about just mentors. And as students being less likely to commit suicide if there was an adult they felt like they could talk to about personal things if they needed to whether or not they had taken advantage of that. In fact, for almost everything, the leading intervention that we could find was improving that connection between professors and students. Whether you want to help more students graduate, more students thrive after they graduate, Frankly, even more students participate in class discussion. For all of those different outcomes, the single best intervention seems to be strengthening that connection. So we’ve shared some ideas in the book, and I might just share from our wonderful friend and colleague, Steve, who can’t be with us today, his thought. He says:

This takes me back to Uri Treisman and his amazing work. Treisman, who teaches at University of Texas-Austin tells his students they can succeed in calculus and that they belong, but he goes far beyond asserting that. He traces for students a mathematical genealogy in which they appear at the end of a long chain of ancestors that begins with Leibniz and Newton. He invites his students to meet with him on Saturdays for one-on-one conversations that may not be about calculus, but which are clearly about their success. The depth of Treisman’s heroic dedication to students astounds me, I may never get close to his level of commitment to his students, but I’ve taken a step in that direction by building one-on-one conversations with my students into the semester schedule. I believe that students understand that time is precious and that even 10 unhurried minutes of unscripted conversation about their plans, challenges, and dreams send a clear message about care and commitment.

So, that’s from Steve Hunsaker, our wonderful co-author.

John: So you mentioned both in your book and in the conversation so far that students do care about whether their instructors care about them. We’re not always very good at sharing that, though. I think most professors do care about their students, but that doesn’t always get conveyed. Certainly learning their names is one strategy. Meeting with them one on one is another strategy. And you mentioned, letting all the students know that they’re capable of being successful is one way of doing it. Are there other strategies that faculty could use to let students know that we do care about their success?

Robert: I’ll start with the baby one, if I might, and this one hurts, because even after presenting and teaching about it, I still catch myself doing this. I’m busy. So when I get an email that says, “I’m going to have to miss class on Monday for a funeral, is that absence excused? Or if not, is there anything I can do to make it up?” I tend to go right to “Oh, that is an absence that can be excused. You get three excused absences after that you can make it=…” And then once in a while, the thought will come to my mind, did you catch the word funeral in the email, they’re going to a funeral. They’re a person who’s going to a funeral. So I’ve tried to stop and say, “I’m so sorry to hear that someone you know and love has passed away? Do you mind if I ask who?” And they’ll email back, “It’s my grandma.” And I’ll say, “Tell me how has your grandma blessed your life? How are you like your grandma? What will you miss most about your grandma?” It takes me like 10 seconds [LAUGHTER] extra typing, but it converts what was a transactional email into a human email. So just to be human in our interactions with students, I think, goes much farther than we might imagine.

Bonnie: I’ll add to that. I think accessibility is something we can build into our lives as we look at our semesters, when we’re accessible to students, and we really do meet our office hours or we arrange to meet with them and that we make ourselves available. I think that sends a message that we care about their success and about them. But I think that’s something to do. I know that one semester, my stat students created a project, where they just said “Now are professors really in their classrooms, if they had a question? And so they went around campus during office hours and checked to see if professors were there. [LAUGHTER] And they had a great project. And they found out that their alternative hypothesis that professors are actually there less than they say turned out true. [LAUGHTER] So we had to do some work. But they cared, they care whether we care. So I think accessibility, and then the one thing I would add to that would be how we structure our courses, like we don’t have to go way out of our way to make this happen. We can restructure our courses so that we get the learning done. And actually, we can maybe even improve the learning as we restructure. So an example would be in one of my classes, I have a lab day built in. And it’s not a lab day outside of class time, it’s not asking them to go get in groups outside of class time, I actually create a lab day during the week that we come together and they get to ask questions, they can talk about the homework, they can work on their group projects, because I care that they have a life. I know my class is not their only class and meeting up with groups is difficult. And I care about that. And so I just build it into my curriculum. And so I do a few more videos, I do a little bit more writing so they have some things to prepare for class. If I don’t need to say it during class, I can put it outside of class. And then during class, we can use that time to collaborate and to foster relationships and to think about deep things and to get passionate about things. Because I’m there, the best time for them, I think, is with me. [LAUGHTER] I want them to be there and I want to be their tutor, I want to be the one that sees how they’re doing on their math problems. When they run into a hard math problem. I don’t want them going to the math lab, asking another student that’s at their same level the question. I want them to come ask me. [LAUGHTER] So I set up a day every week, and that’s what we’re going to do on Monday, it’s going to be lab day. And it’s kind of a nice breather after the first week, because I’ve kind of pushed them a little bit getting started, we get right into the mathematics. And then on Monday, we have a lab day, they can breathe and I can talk to them about how things are going, I can kind of assess how I’m doing with the teaching. And if I need to change things around for the next week, we can build it into our classrooms.

Robert: I’ve started using Calendly or then I moved to Bookings, but to make it easier for students to access me. And so it’s just anytime that’s available on my calendar, they can meet with me. And when they meet with me… I stumbled on this last semester… I’ve said have you got your phone with you? Of course they have their phone with them. Would you mind showing me a photo or two or a video that would help me better understand you. So this morning, a student shows me a fascinating photo of him and two friends and his snowmobile and a big hole that he’d gotten stuck in, and told me about his love for snowmobiling. I will remember him better and understand him better because of that. I’ve been amazed at the things that students have shared with me and how understanding their backstories changes my perception. I remember asking one student “Just tell me your backstory.” He said, “Well, I was abandoned by the side of the road, I guess because I had a cleft palate. And then I was in an orphanage until I was adopted.” He was in another country. Wow. This was a student who sometimes didn’t stop talking as soon as I would have liked him to stop talking after we’d done a small group discussion. I just saw him in a whole different light and was amazed by the things that he was accomplishing. So understanding students’ backstories, I think, helps strengthen that connection we have with them.

Rebecca: One of the things that I really appreciate about the examples that you’re sharing are that none of them are big time commitments. None of them are huge asks, but they’re cumulative when they add up, and they add up in a way that really demonstrates care, and then when I’m doing it, and John’s doing it, and Rob’s doing it, and Bonnie is doing it, then the student really feels supported.

Robert: That would be our dream, the more people who do these kinds of things, the greater the support network for our students. And you know, once in a while, we’ll do some things that we wouldn’t otherwise have done. On occasion, I will walk a student who is suicidal over directly to the mental health center, to the counseling center. And so it takes me five or 10 minutes, but at the end of the day, I feel like those were probably the most five or 10 important minutes of the day. Actually, that does remind me of one other thing. We’ve talked about connecting with the students, course design decisions, classroom tactical decisions, but we do play a role as gatekeepers. We’re in a position, not to provide mental health counseling, but to spot students in need. Students, when we do the kinds of things we talk about, tend to trust us. And then I’m surprised how many will describe what, to me as a layperson, sounds like depression, but they’ve never been treated for it, they’ve never seen a counselor. And so I just make the pitch. “Wow, I’m not a mental health professional, but I’ve talked to many students with similar symptoms who’ve gone to the counseling center, it’s free here, and wow, they’ve gotten some great help, and let me introduce you to some other resources.” So just being that wise friend who knows how to connect people with resources, we’re in a unique position to do that, as professors. We may as well learn how to do it.

John: And I’ve noticed that students are much more receptive to that than they were 20-30 years ago, where there appeared to be more of a stigma associated with that. So reaching out that way can make a big difference. And I know I’ve been referring more students for mental health assistance on campus than I ever have before.

Robert: And we can contribute to that continuing evolution by making our classrooms a safe place by saying “I love to go out into the gardens and meditate periodically, I experience stress and sometimes get physical symptoms. It’s a great way for me to cope with my stress.” By just saying that, I’ve signaled to students that it’s okay to talk about it. Sometimes two or three weeks before the end of the semester, I’ll take a meta moment and say, “Hey, some of you have been here longer than others, what are some keys to not exploding during the final two weeks of the semester. Go!” A discussion erupts in which they’re remarkably candid, and they’re spot on. They talk all about things that Bonnie included in our chapter on wellness. But again, it makes it safe, and they get some good counsel from each other.

Bonnie: I agree. And when we bring that to the classroom, we actually are real, and say, “You know what? I do have some stress. And I’m probably a little overwhelmed right now. And I want to back off and love you guys and set some boundaries for ourselves too.” Like, “I’m going to check my email within 24 hours. But usually after six o’clock at night, I’m done checking email…” and let them know that you’re gonna take care of yourself too. And hopefully, they can see that that’s important to you, and they will say “I need to take care of me too.” And it’s okay to have those conversations and as you develop those relationships, you can be a little more candid and they will feel, I think, more free to come to you when they do have a problem if you’re honest and authentic and say, “Yeah, I’m a real person, like I actually have to eat [LAUGHTER] and take care of myself and I have a goal this semester.” I told my students, on Wednesday, we started, that I’m going to do the lazy woman iron. Is it like the iron woman?”

Robert: Yeah, the Iron Man.

Bonnie: Yeah, the Iron Man, and I said, you know, I’m not good at it. I want to get back in shape after COVID and Christmas. And I said, if I see you guys at the gym, that’d be awesome. Please don’t make fun of me. [LAUGHTER] But I’m gonna be on the treadmill trying to get my miles in, and in a month, I get to do an Iron man. I think I can do that. And it’s just fun to open up with them. And there’s possibilities as you’re studying hard, you can still take care of yourself outside of that, and as your professor, I’m gonna take care of myself, because I want to be good for you. I want to be healthy for you. And I want to be excited to be here tomorrow and the next day, and to do that I want to take care of myself too.

Robert: So promoting wellness practices, I think we’re uniquely positioned to encourage students to get enough sleep, to eat well, to exercise, without being preachy about it, and we’re vulnerable in the way that Bonnie just described. That could inspire a number of students to step back and think maybe I could incorporate more exercise into my daily routine.

Rebecca: Again, those are small things that don’t take a lot of time. It’s a small little conversation or a small little anecdote that you share to set the stage for wellness. So it’s not as hard as sometimes we imagined it to be.

Bonnie: I don’t want to overwhelm professors either, ‘cause it could get overwhelming thinking I need to do all this, but, like you said, one or two things can make a big difference. Just a simple thing that Rob inspired me with and Steve too, to talk about. We live in a place where it’s cold, a lot of the year, [LAUGHTER]…

Rebecca: … me too.

Bonnie: … lots of snow here in Idaho. Yeah. And so it can get a little depressing anyway, because of the climate here. But, I send a roll around to see who’s there every time because I do keep rolls, not for the grade, but just because I want to know who’s there. And I say, “If you’re here I want to know, if you’re not here, I want to know. So I send the roll around, and I sent a question around yesterday about what are some fun things you can do outside in Rexburg, like when you need a break. And so then they write their name down and give ideas and so we send that around and it’s super easy. I didn’t have to take any time out of class for that. They signed up and then the other day I asked, “So, what’s your favorite comfort foods?” just kind of get to know them and show that you care about them. But it’s like a super easy way to take care of things and to inspire them to maybe do some wellness that week. [LAUGHTER] And think about those things that they might not be thinking about.

Robert: Rebecca, you have mentioned this a couple of times that it caused me to look up a quote by one of my mentors who happens to be the father of our current university, President Henry B. Eyring. He talked about how small changes can often have a big impact. And he said, “The best place to look for small changes we could make in things is in things we do often. There is power and steadiness and repetition.” And if we can lead by inspiration, or intuition, if you will, choose the right small things to change, consistent change will bring great improvement. So really, there are some things that we suggest, that if they were to change from one final at the law school to four different tests, and then a comprehensive final, that’s a bigger change. But much of what we advocate in the book is something that you can do quite simply, and much as I love many coherent systems of teaching, they intimidate me, like Project Based Learning, it sounds really cool, it’s just been a bridge too far for me. I just haven’t been willing to make the huge investment, it feels like I would need to make to switch my course over to that all the way. On the other hand, I could show up to class a little bit early and sit next to a student and get to know her, see how she’s doing, and connect with her. That’s a small change I can make.

Rebecca: Related to mental health, one of the things that many of our colleagues have certainly noted and there’s been many articles in The Chronicle and other places about this is the idea that students seem pretty disengaged right now. They’ve survived multiple semesters of COVID and other world complications and seem disengaged. Sometimes they’re doing the work. Sometimes we’re seeing students disappear. Sometimes they’re in class not doing anything. Sometimes they’re doing stuff outside of class. It looks different depending on the students. But there’s this general sentiment of disengagement. How do we help students feel engaged or reinvigorate their energy around learning?

Robert: Let me try three concrete ideas and then I think Bonnie might have some as well. First, at the risk of beating a dead horse, the more connected they feel with us, the less disengaged they tend to be in our classroom. I noticed when I sit next to a student and chat a little bit before class, that student who has not made a comment all semester, a good chunk of the time they will volunteer a comment for the first time. It seems to be a strong correlation there. Another thing that I learned in researching this book, and we did a survey of our students, one of the things that causes the the most anxiety was when the course was moving on, the class was moving on, and they felt like they didn’t understand something. I heard Sal Khan at a talk at Stanford say that the problem with the monolithic approach to higher ed or to education in the United States is that we kind of assume everybody moves at the same speed. So we did a test on chapter one, which is learning to ride a bike and a bunch of students get a C or a D or an F, and then we move on to riding a unicycle in chapter two, and we’re surprised when they fall off. We’ve given them no incentive to go back and master bike riding first. Just this week, I had a conversation with a student who’s a family friend, he grew up in our neighborhood, and he’d struggled. He said, “This is my redemption semester.” He was going to do some things differently. And I said, so here’s what to do differently, especially in your math class. When you get a poor score on a test, try to figure out what things you didn’t understand and go watch Khan Academy videos, or go to the TA or the tutoring lab, and figure out what those things are. I happen to be here on campus last night, and I saw him at about 8:30 when I left, and he had been watching Khan Academy videos, and said this was transformative. It really hadn’t crossed his mind before to fill in the gaps. But what happens I think is if that train leaves with students not on it, they then get disengaged, they’re lost. So if we can build into our course design ways and incentives for them to master what they don’t initially master, I think they’ll remain more engaged.

Bonnie: I agree with all that, actually and thanks for bringing in mathematics.[LAUGHTER]

Robert: Always given you a nod when I can.

Bonnie: I could always use some advice and some help there too. But I wanted to add to that… I guess, maybe emphasize… the importance of that connection, and choice and passion. sometimes we get a little dispassionate with our lives, or we’re going in a direction, it just seems that’s not really where we want to be. And as a teacher, it’s an opportunity to get to know kids, find out what their passions are, and maybe help to see some of that passion in your course. And I realize this might take a little bit more time, but sometimes it’s worth it. When we think about our projects and I find out the students majors and maybe a little bit about what professors they’re also working with, sometimes I can tailor a project to them, like I talked about before, and the students can come alive. At the same time. I think we need to be realistic too, some of these students might not really be disengaged, they might be overwhelmed. They have a job outside of your class. They have another 16 credits they’re taking. They may have other family and things like that that they’re working with. So it might not be about you [LAUGHTER] or your class, it might be about all these other things they’re dealing with and we could try to give good counsel as advisors and mentors and invite them not to overbook themselves. It’s not about how fast to get there but about the journey and as you go, you can try those things, but sometimes, they’re just overwhelmed and they can’t do your class too and do it well and everything else. So, sometimes I do ask my students do you really want to take my class this semester? [LAUGHTER] I’d be happy to see you next semester, but maybe you do need to cut out something because the disengagement might be actually something else.

Robert: In fact, I’ll throw that out too. I try to proactively by the second or third of the week of the semester, now reach out to my students who are falling behind in terms of their grades. Most of them are falling behind, not only in my course, but other courses. And so now I try to counsel them a bit more holistically, not just get my assignments done, it’s “So tell me a little bit about your approach. How’s it compared to what you were doing in high school?” Nobody’s really, especially if you’re a first-generation college student, nobody’s explained the rules that in high school, you could get by with very little homework. And in college, it’s flipped. You’re supposed to spend much more time doing homework. I talked to one student and asked him how much he was studying every day and he said an hour. He said it proudly. I said, “No, I mean, like, for all of your classes, and he opens up his calendar, he said, “No, I’ve got a study hour every day.” And I said, “Oh….oh, oh, oh, did you know it’s supposed to be two hours for every credit hour, like if you’re taking 14 credits, you should be spending 28 hours. Think of it like a job, you want to put in like 40 hours a week. This was an epiphany. I think he was a first-generation college student. Somehow nobody had made that clear to him, and he was failing in almost all of his class. So when we’re proactive, reach out to struggling students early, we often find that they’ve got other issues going on, or just haven’t figured out the rules of the game for college life and how to succeed. And that can cause anybody anxiety.

John: One of the things you suggest in your book is that people consider exploring QPR training. I know we have that on our campus, and we recommend that faculty participate in that. Could you talk just a little bit about that, and what its role may be in dealing with students who face more severe challenges.

Robert: So for me two big takeaways are that just as if you were playing soccer, and a friend crashed into somebody, and you could see the bone sticking out, you would say, “let me help you go to the emergency room.” You’re not a doctor. But if they say, “No, no, I’m fine.” You say “I see the bone sticking out. I haven’t been to medical school, but that seems like a bad thing.” Let’s get you into the car in to the doctor. So just knowing that it’s okay, I think sometimes we feel like it’s illegal for me to engage in counseling. Therefore, I can’t say anything at all about this. So that QPR is kind of a twist on CPR that just as if there are no doctors around and someone’s had a heart attack, it’s helpful to have a civilian do CPR, It’s helpful if I’ve got a student in my office, who I can tell as a lay person and with a little bit of training, wow, they’re struggling to get out of bed. And so now, the other thing I came away with from that is, it’s okay for me to ask “Are you feeling suicidal? Have you had thoughts of taking your life? Have you got a method?” Let me take you to the counseling center, and then just kind of spot. And then the other big takeaway for me was that studies show if they will promise you that they won’t take their life without calling you, people are much less likely to take their life. So I wouldn’t have felt comfortable or thought that was appropriate before I took that QPR training. I found that it’s made me feel like a lay clinician, and it’s alright for me to talk about those things. And now, over the last three years or so, I’ve taken several students who are suicidal to that counseling center. In fact, in a church setting, I was talking about this, and a young woman who was a leader in her congregation texted me that Sunday night and said, “Would you walk with me tomorrow?” She was a leader. She knew exactly where the health center was. She didn’t need me to show her. But she wanted someone just to walk her over there. And I asked her before we went, “Are you feeling suicidal?” And she was. So just to be that friend who can connect people in dire need with mental health professionals is a critical role that I think any of us can play in any walk of life, but especially as teachers.

Rebecca: For those that aren’t familiar, QPR stands for Question, Persuade and Refer.

Robert: Thank you.

Rebecca: I was looking enough just to make sure I had it right. [LAUGHTER]

John: And the training tells you what questions to ask including, “Are you feeling suicidal?” and then persuade them to get assistance and refer them to the assistance, including walking people over when needed.

Rebecca: I know that when I went through the training, I quite literally used it the next day. So it’s a useful thing to take the time to learn. And it does give you the tool set or the toolbox to feel like you can engage when necessary.

Robert: It probably gets your antennae up too.

Rebecca: Yeah.

Robert: You might have spotted that thing before but I think I’m more likely to spot some things now, to see disengagement that’s kind of come on quickly to the student in class or absences and reach out.

Rebecca: Or maybe to act on the thing that you spot that you weren’t quite sure of.

Robert: Yes.

John: We always end with the question: “What’s next?”

Bonnie: So next, I’m going home. [LAUGHTER] I can answer this so well, and eating the dinner that my husband, I think, made for me [LAUGHTER] after this first stressful week of the first week of school because he knows I’ve been so intentional this week about trying to be there for my students. I’ve worked long hours this week. I haven’t taken care of myself as much as I want to. So I’m going to go home, take care of myself this weekend, and hopefully, on Monday be refreshed for my students and I’m so excited to keep using some of these ideas and becoming their friends. I love working on my classes because I feel like we’re friends, and it’s only been three days, but I can’t wait to see my friends on Monday and I hope they feel that teamwork and that team that we become, I think, as we become a team throughout the semester. Some of these things don’t come up as often in my class, I don’t see the stress as often as they feel that teamwork. So I think the next thing for me is just to continue to work on being a good team member and creating this team that I want to see this semester… after I get some good dinner and a good night’s rest. [LAUGHTER]

Robert: I’m glad you at least include a good dinner because I feel like my answer is very selfish [LAUGHTER] compared to your selfless outward facing answer. But my career’s been unusual. I’ve spent about half of my time at BYU Idaho in academic leadership. And so just in the last couple of years have been able to dive in and research and write about these things. I’d kind of like to go speak to people who are interested in hearing about this, do workshops together with people who are learning how to improve this. I also helped teach a course that I designed and have team taught for the last six years with a couple of colleagues here for our new faculty. It’s a semester-long course. And so I’ve recently written a textbook for that course. That’s kind of all the stuff we think new teachers should know. I think we’re calling it Architects of Learning. And so I’ve got that to a point where eventually I’ll pursue publishers, figure out how to get those ideas out there as well. But build on some of the kind of the same stuff that’s laced through this book about just being intentional about the decisions we make in our tactical classroom decisions and our course design decisions can go a long way to improving learning.

Rebecca: Thank you so much for joining us. We really appreciated getting to know you and your work better and sharing it with our audience.

John: While we were able to see an advance copy of this, we are wondering when the copy will be released to the public. Mine is on preorder.

Robert: Yes, so it’s preorder and it’s March or April, West Virginia University Press has told us. So we’re looking forward to that actually getting out there soon. And we’re so grateful that you would have us on your show. We love connecting with kindred spirits who care about teaching and learning and education can do to make people’s lives better. Thank you.

Bonnie: Thank you.

Rebecca: Thank you

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

268. Advancing Inclusivity while Mitigating Burnout

This episode is a live recording of a panel session at the Online Learning Consortium’s Accelerate Conference in Orlando on November 17, 2022. The panelists were Michelle Miller, Liz Norell, and Kelvin Thompson.

Michelle is a professor of psychological sciences and a President’s Distinguished Teaching Fellow at Northern Arizona University. She is the author of Minds Online: Teaching Effectively with Technology and also more recently, Remembering and Forgetting in the Age of Technology: Teaching and Learning and the Science of Memory in a Wired World, which was recently released by West Virginia University Press. Liz is a political scientist, and an associate professor at Chattanooga State Community College. She is also an experienced registered yoga teacher with over 500 hours of training completed. She is currently working on a book on Why Presence Matters in High Quality Learner-Centered Equitable Learning Spaces. Kelvin is the Executive Director of the University of Central Florida’s Center for Distributed Learning, and graduate faculty scholar in UCF’s College of Education and Human Performance. He developed the open courseware BlendKit course that many of us have taken, and cohosts TOPcast, the Teaching Online Podcast.

Show Notes

  • Panelists:
  • Miller, M. D. (2014). Minds Online: Teaching Effectively with Technology. Harvard University Press.
  • Miller, M. D. (2022). Remembering and Forgetting in the Age of Technology: Teaching, Learning, and the Science of Memory in a Wired World.
  • Norell, Liz (forthcoming). Why Presence Matters in High Quality Learner-Centered Equitable Learning Spaces. West Virginia University Press.
  • BlendKit
  • TOPcast
  • Brandon Bayne’s twitter post on the adjusted syllabus.
  • Nick Sousanis’ syllabi
  • Behling, K. T., & Tobin, T. J. (2018). Reach Everyone, Teach Everyone: Universal Design for Learning in Higher Education. West Virginia University Press.
  • Teaching Online Pedagogical Repository (TOPR)
  • Joosten, T., Harness, L., Poulin, R., Davis, V., & Baker, M. (2021). Research Review: Educational Technologies and Their Impact on Student Success for Racial and Ethnic Groups of Interest. WICHE Cooperative for Educational Technologies (WCET).
  • Hammond, Z. (2014). Culturally responsive teaching and the brain: Promoting authentic engagement and rigor among culturally and linguistically diverse students. Corwin Press.
  • Eaton, Robert; Steven V. Hunsaker, and Bonnie Moon (forthcoming, 2023) Improving Learning and Mental Health in the College Classroom. West Virginia University Press.
  • Enneagram test

Transcript

John: This is a recording of a live panel session that took place during the Online Learning Consortium’s Accelerate Conference in Orlando on November 17, 2022. We hope that you enjoy it as much as we did.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Welcome to “Advancing Inclusivity while Mitigating Burnout.” I’m John Kane, an economist and the Director of the Center for Excellence in Learning and Teaching at the State University of New York at Oswego.

Rebecca: I’m Rebecca Mushtare, a designer and an Associate Dean of Graduate Studies at SUNY Oswego. We’re the hosts of the Tea for Teaching podcast and the moderators for today’s session. We’d like to let everyone know that we’re recording this session in order to release it in an upcoming episode of Tea for Teaching. And today’s session will include 30 minutes of moderated discussion, followed by 10 minutes of questions from all of you, and I’ll turn it over to John to introduce our panel.

John: Our panelists are Michelle Miller. Michelle is a professor of psychological sciences and a President’s Distinguished Teaching Fellow at Northern Arizona University. Michelle is the author of Minds Online: Teaching Effectively with Technology and also more recently, Remembering and Forgetting in the Age of Technology: Teaching and Learning and the Science of Memory, which was recently released by West Virginia University Press. We also have Liz Norell. Liz is a political scientist, and an associate professor at Chattanooga State Community College. She is also an experienced registered yoga teacher with over 500 hours of training completed. She is currently working on a book on Why Presence Matters in High Quality Learner-Centered Equitable Learning Spaces. We also have Kelvin Thompson. Kelvin is the Executive Director of the University of Central Florida’s Center for Distributed Learning, and graduate faculty scholar in UCF’s College of Education and Human Performance. He developed the open courseware BlendKit course that many of us have taken, and cohosts TOPcast, the teaching online podcast.

Rebecca: This wouldn’t be a complete episode of tea for teaching if we didn’t ask about tea. So Kelvin, our coffee drinker, are you drinking tea today?

Kelvin: I am drinking tea today, Rebecca, this is a mint tea from Tazo. I have to admit, I went looking for my favorite conference tea, which is that orange Tazo tea that I looked everywhere and they didn’t have any.

Rebecca: Ah, a little bummer. Michelle?

Michelle: Well, true to form, I’m drinking coffee and I’m going to admit that I also mixed it with Swiss Miss hot chocolate, [LAUGHTER] a very guilty pleasure on many levels.

Liz: I don’t drink anything hot. So I’m drinking diet coke.

Rebecca: Woo!

Liz: Thank you.

Rebecca: As many guests before you have as well.

Liz: Yeah. [LAUGHTER]

Rebecca: John?

John: And I am drinking an English breakfast tea today.

Rebecca: And I have some very strong Awake tea, so that we’re really awake for this episode.

John: The pandemic spurred a rapid transition of instructional methods and an increased focus on inclusive teaching, and we want to talk a bit about that in today’s session. We’d like to ask the panelists: What were some of the improvements in inclusivity and building a sense of belonging, that you’ve observed during the pandemic? …with particular emphasis on remote and asynchronous courses. And Liz is going to start.

Liz: What I found, particularly in asynchronous online courses, is that I have noticed this has much broadened the ability of neurodivergent students and students who have some kind of disability, especially an invisible disability. And the way that it’s done that is by really forcing us to accept multiple kinds of student engagement. So what I noticed in March of 2020, is that students who had been almost invisible in my face-to-face class, when we came back to Zoom after spring break, I didn’t see their faces, but I heard their voices, if not vocally than in the chat. And I have so thoroughly appreciated that. I also learned from my students that you can change the way you show up in Zoom by getting one of those little lens things over your camera and changing your virtual background. So oftentimes, they would come into a Zoom room, and this would be in a synchronous class, and they would have a different cartoon character of the day. And this is a wonderful way to get to know more about them and their personalities. What I’ve also found is that when we are meeting synchronously, recording the classes is really helpful for a lot of learners. And so, since I’ve gone back to face-to-face teaching, I always open a Zoom room and record it and sometimes students will join by Zoom because they can’t come to campus that day. My partner who teaches math has also started doing this because they found that it’s really helpful for the students to be able to review what they did in class when they’re trying to apply it in their homework or preparing for an exam. The last thing I want to mention is that I teach political science, we always do a unit on civil liberties. And one of the things that I did in person was bring in a prop box and have them do skits where they acted out the precipitating events to major Supreme Court civil liberties cases, and I thought there’s no way we can do this over zoom, right? Yes. And it’s just getting really creative with Zoom backgrounds, with props that they have in their houses. It makes it so much more campy that it’s much more fun, because in person they always like “Oooh, I’m nervous.” In Zoom, it’s going to be a train wreck, okay, we’re just gonna embrace that, and that really creates a really fun dynamic in the classroom.

Kelvin: I would agree with the broad brushstrokes of what Liz said, I would like to broaden it further though, and say that throughout the last couple of years, what I’ve seen in a way that I’ve never seen before is an emphasis on empathy, and what we might call a human first orientation. I was really heartened to see that in a lot of ways in the early days of the lockdown era of remote instruction, and I still see ripples of it now. Two things that come to mind from the early days that are worth a review, if you haven’t looked at him in a while. One that got kind of viral, the so-called adjusted syllabus of Brandon Bayne from UNC, where he got really kind of real and transparent with students and released it out all over for adaptation. And then Nick Sousanis from San Francisco State University more recently had what he called notes on now as a syllabus section that just kind of, in a more encapsulated way, he sort of said that he wants to keep anchoring down to that human-first element, and just keep that a present part of every course’s syllabus.

Rebecca: Thank you, both Liz and Kelvin for giving us some insights into what we’ve already been experiencing and reminding us about some of the strong improvements that we’ve had. Many campuses are moving back to onsite instruction, while also considering how much of their portfolio should be including online options. And while each campus continues to adapt and adjust, how can we maintain the momentum around inclusive practices and avoid slipping back into our old habits? Michelle, will you start us off?

Michelle: And I love the framing here as momentum, because I think that many campuses have generated a lot of great energy around the why of inclusion, the why of equity, the why of justice, and why this is so important. The trick is going to be to follow that energy on with more on the what and how… how do we put that into practice. And I really struggle when I think about it, because our students, they need practice when there’s a new skill, a new way of responding. They need practice in lots of new contexts. And I talk a lot about transfer. And we may remember a skill or develop a skill in one context and we just don’t remember to activate it and carry it through in a new context. And we’re going to need that. We’re going to need to have certain techniques and teaching moves that do become second nature to us and be able to recognize, hey, this is one of those opportunities to put those into practice. So I was just doing a session this morning by a group from the University of Wisconsin. And they talked about, for example, the need to provide lots of concrete examples to faculty like what does this look like? Maybe even in your discipline? So, for example, increased course structure, we know this is proven to be an inclusive teaching practice. So I need to say, “Oh, yeah, this is the place to do this.” The frequent low-stakes assessments, we know that that reduces disparities in opportunity and disparities in achievement across many student groups. And so offering those concrete paths, making sure we know how to set them up, and then showing faculty that we see it when they’re making the effort and rewarding that. We don’t always need that little extrinsic reward, but institutions have to really keep that up if they’re going to see that this carries through, because that’s going to be the difference between institutions that really have that momentum moving forward and the ones that fall behind.

Liz: I agree… [LAUGHTER] with what she said. I come at this from a little bit of a different perspective, because I am in the classroom, or at least in a virtual classroom. But I think the word that comes to mind for me when I think about momentum is intentionality. And I think if we can remember to teach through our values, especially those values that became so crystallized during COVID, that’s a really good first step. And I’m fond of saying that what’s good for students is good for us. So I want us to think about the ways that we prioritized care, humanity, grace with our students, and also make sure we’re doing that for one another and for ourselves. And I mentioned this before, but COVID really revealed a lot of inequities that had been there for a long time. And now that we know that they’re there, we have to be very intentional about ensuring that they don’t just kind of go back to being invisible again now that we’re not all on Zoom together. So those are the things that I’m thinking about. It’s really leaning into our values, not forgetting what we learned, being intentional and doing for ourselves what we have seen we need to do for our students.

Rebecca: That’s a great reminder to think about not just the students, but the whole community, faculty, staff, etc.

John: During the early stages of the pandemic, we saw a lot of experimentation. And we saw the rapid growth of remote synchronous instruction and HyFlex instruction. And one of the things I think many of us are wondering is what roles they will play as we move forward into the future. Helvin?

Kelvin: Well, my crystal ball never was working. [LAUGHTER] It’s not even broken. But here’s kind of what I think is happening and what may continue to happen. I think synchronous online options will continue to be a factor in our digital teaching and learning in a way that it was not before the pandemic. And it is certainly possible that what I refer to as true HyFlex may still have a place as well. It’s just, gosh, it’s hard to pull real true HyFlex off, right? It’s such a design-intensive approach. What I contrastingly refer to as pseudo HyFlex… dual mode, simulcasting, webcasting of classroom experience… that has challenges. It has a place, perhaps, in individual instructor preference. But I’m going to tell you, firsthand from faculty colleagues I talked to as well as data I’ve seen, it’s exhausting. And it’s challenging for students, the what is sometimes touted as student flexibility ends up just becoming sort of a lowering of expectations and come and go as you wish and the intentionality and momentum seems to dissipate. I’m a big fan of intentional design and modalities of choice, and so forth,,,that way, instead. So, I think synchronous is around and I think our mutated modalities are around. And true. HyFlex has a place. But I’d love to see a diminishing of pseudo HyFlex.

Michelle: This is sparking so many of my own thoughts that I’m really feeling in a way validated here. And I’ll echo a lot of this as well. I think that again, in true HyFlex, where I am fully engaging the folks who are all spread out, I’m fully engaging whoever’s in my classroom, and we’re achieving all of our objectives. That really is a lot. And it’s not the technology. It’s the cognitive capacity. And as a cognitive psychologist, I say, “Well, when you practice remembering to read the chat and read the room at the same time, those demands get a little bit less, but they don’t go away. It’s just too complex.” So I think that we are going to have, yeah, the true bonafide HyFlex courses going forward, they need to be designated, they need to be supported in a particular way. So they may not be unicorns exactly, but I kind of see that coming forward. What I feel like I’ve kind of settled into a more HyFlex light, HyFlex infused is, for example, if you’re home and you’re remote, you need to be remote today, I don’t have an elaborate Google doc with a structured discussion maybe for you. But you can follow along, you can send in a participation card, I do give a lot of credit for participation, and so we’re kind of moving to that. I do think that we still have a sense of possibility. I mean, we have definitely gotten those skills, and we will find new ways to use them. But even just the basics, like “Hey, you can record your class meetings.” And I offer that too as an option for catching up sometimes where needed. I really thought that was going to be a disaster for a lot of different reasons going on. I said that’s not going to work. And I will eat those words now. So we have a few of these tools in our toolkit that we can use in this lower key way, I think.

Rebecca: So Kelvin, you mentioned the ability of changing modalities and offering some flexibility here. And the ability for students to choose the modality that they take the course in is just one of the ways that we’ve seen increased flexibility. But we’ve also seen increased flexibility around attendance, assessments, and many other aspects of teaching. How can we continue to support increased flexibility for students without overburdening faculty. I’m really hoping you all have some magic that you can help with.

Michelle: Yeah, so increased flexibility without the overburdening of faculty… When I reflect on this, I think we can borrow from the plus one strategy that you might be familiar with from Universal Design for Learning. Tom Tobin and his colleagues who write about this… the idea being that, yeah, we’re working towards perhaps a very rich environment with many different ways to demonstrate what you know, to take a test, to participate in in a learning activity, but you don’t do it all at once. And I also think, too, that I know that I’ve gotten, I think, pretty adept at finding those opportunities for flexibility that don’t necessarily add more for me to do and I think an example of this would be the way I give exams these days. So during the pandemic, I said, there’s always going to be an option instead of sitting for a traditional test. So I have an option that’s an essay paper with length and scope parameters and so on. But students can structure this. I suggest they often structure it as an email home to your family about what you’ve learned during this portion of the course. I’ve had a few students who have run with it as a science fiction writing exercise, which works great in psychology. So people will report home to their alien commander or home base about what they’ve learned about humans on Planet Terra. And those are, if anything, just a change of pace for me to read. I’m reading the exams anyway. So I’m always about the efficiency and so that’s something that I’ve tried to capture as well. But here too, we have to remember there are risks when we offer these and faculty who do go out on that limb and try it the first semester or two… maybe it doesn’t work perfectly… they’ve got to be affirmed, and they’ve got to be protected especially untenured. Folks,

Kelvin: I feel like I want to report to my alien commander now. [LAUGHTER] “Mork calling Orson, Mork calling Orson,” that’s a deep cut call back, you have to be of a certain age to appreciate that. I agree with a lot of that. I don’t think I disagree with any of that. But I will broaden out a little bit and maybe anchor back, Rebecca, to your prompt a little bit. I personally think we should lean into intentional course design in intentionally designed and created modalities for which student flexibility is the intent. Asynchronous online is probably the most flexible thing we offer outside of maybe true adaptive learning, which is… don’t get me started… that’s another whole tough banana to peel. I need a better metaphor… bananas aren’t that tough to peel… [LAUGHTER] a tough onion to peel, there’s lots of tears. I don’t know… something. And then I think we need to reiterate to ourselves and to our faculty colleagues that there are codified effective practices in each of these course modality domains, like… a shameless plug… at UCF, we host the teaching online pedagogical repository (TOPR), an online compendium of online and blended teaching and design practices. So there’s stuff that we know that are research based, time honored, that work well and benefit students, things like the broad category of learner choice, which I think just echoes a little bit of what Michelle was saying. We don’t have to reinvent the wheel if we lean into those things. And there’s real student benefit for doing that.

John: The disruptions we experienced in education during the pandemic when people were learning remotely affected all students, but disproportionately affected students who are first-gen, students from low income households and minoritized students. How does higher education need to adjust to meet the diverse needs of all of our students, some of which were not as affected by the pandemic if they were in well-resourced school districts and others that were left behind a bit when they didn’t have access to the technology or the resources that better funded school districts had?

Kelvin: Yeah, we could do better. Even here at the conference in which we’re participating here as we record this, we saw even today, student voice represented on stage and I think we can do better with that. There’s knowing who our students are, there are data that we are collecting and could collect that tell us something. But there’s also just attending to students’ personal stories, keeping a human face on the student experience, being grounded in our work there. But broadening further, again, I’m a big advocate of research-based and time-honored teaching practices. And in our digital teaching and learning domain, many of those have been shown to benefit minoritized and disadvantaged student sub-populations. I would do a shout out here to Tonya Joosten’s research review that has its long title. It’s got educational technologies and student success and racial and ethnic groups of interest all in the title. It can be Googled, it’s free, it’s available, but she does a nice job of reviewing and synthesizing the extant literature and making some recommendations from that. And so there are ways in which our online and blended in particular design and teaching practices benefit everybody but in particular, benefit first-gen, minoritized students, and so forth. And here’s a little free factoid… in a little fascinating recommendation. She says, you know, there’s some evidence to suggest that reduced seat time blended courses at the lower-division level particularly benefit disadvantaged students subpopulations and then going into online courses at the upper division in the major kind of courses. Those two things together. You know, it’s stunning, that’s not whiz bang, whirly gig shiny, right? …but it’s just doing the work but as we align that it really has benefits that evidence would bear out.

Liz: I just want to start by echoing something that Kelvin mentioned, which is that if we’re going to serve the students we have and the students that we will have, we have to know who they are. And there are studies of generations and qualities, but I don’t think anything replaces asking the people in your classroom about themselves in a way that is safe and non-threatening, but comes from an authentic place of curiosity. So I do this with my students. At the start of every semester, I ask them questions, none of them are required, but I ask them questions about things like, what kinds of technology do you have? And how many hours a week are you working? And which of this very long list of challenges do you think you might face during the semester? What kinds of things can I do to help you? …just so that I have a sense of who’s in the room, and what might be going on with them. So just yesterday, I was teaching my Zoom class from upstairs in my hotel room, which I was very grateful for, because I’m an introvert, and this conference is overwhelming. So I was happy to have an excuse to get away for three hours to teach. But we spent 20 minutes just asking, “How are you? No, no, how are you?” Not, I’m fine. I’m okay, but what’s going on? And one of my students said, I’ve always struggled with depression, and I thought I had it under control. But the last week has taught me that I don’t. And it’s only because we’re in week six of a seven week class that that student felt like he could say that, and the whole class could say, “Me too.” And those moments, I think that is so critical. And it’s just the humanization that we’ve already talked about, and meeting people where they are, I want to put in a plug for Zaretta Hammond’s book about, I don’t remember the full title, but it’s the brain and culturally relevant responsive teaching. It’s got a lot of really good buzzwords in it. But it talks about how, when the brain is in a state of trauma, or stress, you can’t learn. And so we can talk about all of these things that we can do. But if our students are not in a place to hear it, nothing that we do is going to make a difference. And I think if we’re talking about how to teach the students we have, we have to be aware of that before we can move forward.

Rebecca: So you’ve nicely connected to our next topic. [LAUGHTER]

Liz: …almost like I meant to.

Rebecca: lI know, it’s almost like you knew it was coming. Campuses are seeing a rise in mental health needs in their student bodies, both prior to the pandemic and it obviously continues to increase. And shifting to more inclusive practices is shifting the relationship that students are having with the faculty, just like you mentioned, being able to be more open about some of these things. In my own experience, I’ve seen an increase in disclosure of mental health challenges and distress and the need to refer and actively engage in suicide prevention. These are things that I didn’t need to do five years ago, [LAUGHTER] or maybe I didn’t need to do but didn’t see, but definitely see now. So how can faculty and institutions more effectively respond to mental health challenges facing our learning communities? And obviously, Liz, you kind of started us off on some ideas here. Michelle?

Michelle: Yeah, I’d like to put another book on the radar actually, as well. And full disclosure, I was an editor on this book, but I really believe in it. It’s coming out next year, actually, it’s called Learning and Student Mental Health in the College Classroom, lead authors, Robert Eaton. And it is in this space of friendly, actionable strategies when we do have increased disclosure. I mean, I found too, that Zoom itself is a sort of a dis-inhibiting space, like many online spaces are and going in I should have known that. it’s like on paper, I’ve read it, but then it became very, very real. So what do we do with that? Because the thing for faculty is, we mean this well, but our minds immediately go to: “How do I fix it? Oh, my gosh, do I have to kind of do amateur therapy that I’m not qualified to do?” And no, that is absolutely not what we need to do next. It’s a good thing to be concerned about not crossing boundaries at that same time as we are responding to what students are disclosing for us. So the strategies that I like are those that say, well, let’s start by not accentuating the crises and the stresses that are there. And a few other kind of concrete things… For me, not asking for doctor’s notes. Boy, when I started teaching a long time ago, I was all about the documentation and “show me exactly what happened at the emergency room,” and that type of thing. So now I offer flexibility and many paths to catch up that much like universal design for learning are built in for everyone from day one of the course. So if there’s something that prevented you from coming to class or making that deadline, okay, we can talk about it if you want, but we don’t have to. And you can simply take those paths that I’ve already laid out for you. I think taking the time to empathize, many of us did practice those skills and we can continue to do so. When I get to talk to people who are just starting out as teachers, I say, “You have this big loud microphone, this megaphone to a student’s ear. Your words land very, very powerfully. So you really need to think about those.” I find that my students seem to come to me expecting very harsh treatment and very harsh reactions, when they tell me about what they’re going through. And so I remind myself to simply start with warmth and compassion and human empathy, and a way forward. So that’s something that we can do. And when all else may fail, I say “How would I want my own child, in the same situation, a crisis, which is hopefully temporary and passing… how would I want them to be spoken to? How would I want that email to be phrased? What kind of pass forward would I want for them?” So that’s how I take it.

John: We’re a little behind schedule. So we’re going to ask anyone in the audience to come up to the microphone. One of the issues we haven’t quite gotten to is the issue of preventing burnout. Maybe if Liz could address that briefly while people come up.

Liz: So I want to talk about burnout in a very particular way. Because I think we often think of burnout as a me problem. And I think of burnout as an every one problem. It is a system that is creating it. And so I want to tell every one of you listening, that you are not the problem, and you haven’t done anything wrong. But in order to mitigate burnout, we have to be aware of what our boundaries are. And that often requires getting really quiet, and listening to ourselves. Because we’ve been steeped in this culture that tells us that hustling and productivity is the only way you’re valuable. And that is not true. But you’re not going to be able to figure out what your boundaries are if you’re listening to those voices. So you got to step out of that for a minute, and figure out what really matters to you. And here’s a good way to do it. Think about yourself 20 years from now. What are the things that are going to have mattered about what you’re doing right now? And what are the things that you won’t really care about? Choose to spend your time on the things that will matter to you 20 years from now, and all of these other kind of petty political debates in your institution… because we all have them… that’s not what you’re going to be remembering when you look back on your career. Focus your energy and your care on the things that you’re going to care about over a career and make choices accordingly. I think that’s the advice I would give.

JELISA: My name is Jelisa Dallas, I’m representing the University of Phoenix. My role is as a recognized student organization manager, a program manager. And so my question was, “How do we effectively work with students in a way that’s going to help streamline their purpose as it pertains to connecting with them in the classroom? So a lot of students have a lot of things going on, and how do we streamline that to get them to stay focused and prioritize when so much is going on and around?”

Liz: Thank you for the question. I mean, I think it’s making sure that what we are doing, we’re transparent about why it matters to them. And it’s creating relevance to whatever their goals are. And of course, you can’t do that if you don’t know what they are. So again, you need to know your students, but designing the work for your class, so that it feels intrinsically valuable, I think, is the best advice I can give.

ALI: Hi, I’m Ali Kirwen, I am a course operations specialist with the University of Michigan, we are an all online program, or I work for an online master’s program. It’s asynchronous, we have students everywhere in all different time zones. And we have faculty that care a whole, whole lot about our students. So I’m wondering, as a designer, how can I help encourage my faculty to set boundaries with their students in a way that honors their joy of teaching and interacting with their students, but is working towards preserving them and not burning them out as well? [LAUGHTER]

Michelle: Well, I think that even subtle things like wording choice. So are there things that say over and above, do we give awards for the person who did the most? Or do we give awards for people who did the best? So I think that faculty, especially when they’re new, are really looking for those cues. And so those can be powerful.

Kelvin: What Michelle said… [LAUGHTER] No, what Michelle said but just maybe that underscore and amplify that for a second, I’ve thought about doing this myself, and I just haven’t. But I love the colleagues and maybe some of you are them who have those little statements in the bottom of your email, right? Like, “if you’re getting this email, when you’re not working, don’t feel some sort of obligation to respond right now. I sent it at a time that I was working, that might not be the time that you’re working. And, in a collegial sort of way, we can have that same kind of a vibe, I think, in our course interactions between faculty and students. And then again, wording… I got a note just last night on a book project I’m working on from a colleague who’s gonna peer review. And he said, “I show my respect by being direct and blatantly honest.” And so I think framing is everything. Word choice is everything. And making explicit where you’re coming from without just sort of caving to the implicit pressures and cultural expectations. That’s hard. But it’s important.

Liz: Yes. And women in the academy, we do a lot of emotional labor. And that comes very naturally to me, if you know anything about the Enneagram, I’m a 2, like, I want to fix all your problems, okay. But the way that I do this, because students tell me everything. I think they tell me everything, because they know that I will listen. But what I have learned for myself, and this has been the difference between moving towards burnout and not, is that I am here to listen to you deeply. I am not here to fix your problems. And I will refer you to people who can help you. But if you just need to be heard, I will listen. And sometimes that does get heavy. But I also recognize that if I fix all the problems for all the students, I’m going to be exhausted. And that doesn’t really serve them in the long run. Because they don’t need someone to fix their problems. They just need someone to tell them that they’re okay and that I believe in you, and I care about you. And so I would say that, but deep listening is one of the greatest gifts you can give someone else. And that’s just listening to understand what they’re saying, not to respond. So that’s what I would say. And please never send pictures from the ER, never. [LAUGHTER] You know, students tell them, no ER photos,

John: We always end by asking: “What’s next?” …and we’ll start with Kelvin.

Kelvin: Crystal ball, still not working. [LAUGHTER] But here’s, I guess, my read on the situation, there are more options for people to learn and work than there ever have been before. So I think that we can either meet the needs of our colleagues and our learners, or someone else will when they go elsewhere.

Michelle: What’s next for me, I want to keep doing the absolute best I can teaching my actual classes. I’m just reconnecting so much with that. And I think that’s a good thing for now. And I’m eagerly looking at, hopefully, deeper changes in the academy, also looking for rebuilding online presence. Twitter used to be a big part of my online life and I quit that in May, and saying what kind of connections was this yielding with other faculty, even with students and the big ideas in my field. And maybe I can take more charge and have more agency in that going forward?

Liz: I’m working on a book. So you should all buy it when it comes out. Michelle is the editor, so it’s going to be really good. [LAUGHTER] It’s tentatively called The Present Professor. And we mentioned it in the introduction. But really, I’m just looking for ways where we can create more student centered,e students supportive and faculty well being centered places of learning. That is my passion. And I’d love to talk to any of you who are interested in that.

John: Thank you all for coming. And on your tables, there’s little packets that Rebecca designed with some tea in them, so please take them with you so she doesn’t have to bring them back to Oswego.

Rebecca: Yeah. Thank you all for joining us. And thanks for those that asked questions. And thank you to all of our panelists and we finished on time. [APPLAUSE]

Liz: It is exactly 12:30.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

266. The Secret Syllabus

Students transitioning from high school to college, especially first-generation college students, are thrust into a new environment for which they are often under-prepared. In this episode, Jay Phelan and Terry Burnham join us to discuss strategies that students can use to successfully navigate the hidden curriculum of college.

Jay is a biologist at UCLA and the author of What is Life? A Guide to Biology. Terry is a finance professor at Chapman University and the author of Mean Markets and Lizard Brains. They are the co-authors of the international bestseller Mean Genes. They have also recently published: The Secret Syllabus: A Guide to the Unwritten Rules of College Success.

Show Notes

  • Hertweck, K. L. (2014). Mean genes: From sex to money to food: Taming our primal instincts, by Terry Burnham and Jay Phelan.
  • Phelan, J., & Burnham, T. (2022). The Secret Syllabus. In The Secret Syllabus. Princeton University Press.
  • Charles Plott
  • Vernon Smith
  • Brickman, P., Coates, D., & Janoff-Bulman, R. (1978). Lottery winners and accident victims: Is happiness relative?. Journal of personality and social psychology, 36(8), 917.

Transcript

John: Students transitioning from high school to college, especially first-generation college students, are thrust into a new environment for which they are often under-prepared. In this episode, we discuss strategies that students can use to successfully navigate the hidden curriculum of college.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Jay Phelan and Terry Burnham. Jay is a biologist at UCLA and the author of What is Life? A Guide to Biology. Terry is a finance professor at Chapman University and the author of Mean Markets and Lizard Brains. They are the co-authors of the international bestseller Mean Genes. They have also recently published: The Secret Syllabus: A Guide to the Unwritten Rules of College Success. Welcome, Jay and Terry.

Terry: Hello.

Jay: Thank you. Good to be here.

John: Today’s teas are:… are either of you drinking tea?

Jay: I’ve never had tea in my life, I’m sad to say… or coffee. But in the spirit of caffeine, I’m having a Diet Coke.

Rebecca: A very popular choice on this podcast for sure. How about you, Terry?

Terry: British mother, a lot of tea in the house at times, but very little in my body.

Rebecca: [LAUGHTER] We’ve got tea deniers around here, John.

Jay: [LAUGHTER]

John: As usual.

Rebecca: I have a black tea blend today. It’s just called All India Tea.

John: That’s a new one. And I am drinking ginger peach black tea.

Rebecca: So we’ve invited you here today to talk about The Secret Syllabus. Can you tell us a little bit about how the book project came about?

Jay: Sure, I’ll start. I was thinking about this because earlier today I was looking at what I think of as maybe the origin document, and it’s from about 25 years ago, it was maybe 1997. It’s a document, it’s 136 pages long. And it’s this collection of emails and other student interactions that Terry and I had had over the years where students are sincerely trying to get stuff that they want. And they, more often than not, go about it in completely the wrong way. It’s either unprofessional, or maybe it’s rude, or maybe it’s just bizarre, or for whatever reason it’s not likely to get them the outcome that they want. And at first we’d laugh at them. But after a while you start thinking, “no, this is kind of tough for them.” It caused me to look back to the 1980s, where I had been a student. And I had been a very promising student coming in from high school. I had done well, and then I got to college, and I just was a terrible, terrible student. And I got bad outcomes. And it was all a big surprise to me, because it just was a different world than I had expected, and I was not equipped for it, sort of those two things together. Terry and I’ve talked about this and laughed about this a lot, but finally it came to a point where we said, “well, we should be doing something about this, we should at least try to help them.” And that was maybe how the ball started rolling, but it had a long, long gestation time.

Terry: Right, I would add to that… idea is to help students be more effective, when in this sort of promotional view… work half as much get better outcomes, and outcomes are not just grades, but grades are important. And as Jay noted, both of us came from great undergraduate schools and we both stumbled. We ended up getting masters from MIT and Yale respectively, then our PhDs from Harvard. And you might think that we had no troubles as undergraduates, and we did. So almost everybody has a problem adjusting to college, even if they end up doing fine. For me, I’m going to admit that I vandalized a lot of classrooms at the University of Michigan. So I sat in these classes with up to 400 people, I usually sat in the back. It looked to me like the professor was like a little puppet down there on stage, and I felt completely disconnected. And these old wooden desks that you would bring the arm down on, and I wrote on those in my days of discontent, “Frodo lives,” “Frodo lives.” I scratched it into the wood. I went back and taught there many years later, and there were still some of the desks [LAUGHTER] that said “Frodo lives” in there. And I took a semester off from school, and anyway, so almost nobody has a dip when they get to college, and it’s not for the fact they’re not smart enough. It’s because they don’t understand the world of college. And having noted, literally now thousands of students who have had the same problems that we had, and sometimes worse, thought we would write a book to help students.

John: So you came in with a lot of advantages and experienced trouble, but many of our students come in and don’t make it through. And that’s especially true for students from low-income school districts where they’ve had few resources and very little college prep in terms of the coursework they had or guidance in terms of how to be successful in college, and many of them are first-generation students. So we’ve got all these students who come in, they borrow a lot of money, and then they end up without a college degree and a huge burden of debt. Would a book such as yours help these students in learning to adjust to the new culture that they’re suddenly being thrust into?

Jay: Well, that is certainly the hope, I’ll tell you. I’m a first-generation student, and my parents are both very smart, and I think could have done college, but they didn’t. And when I grew up, we were extremely poor. I had never been out of Northern California. I’d never been on a plane when I applied to college, I had to apply just sight unseen, and all of that. And I think that was a factor maybe in why I struggled so much when I first got there was that I didn’t have a world of people around me that that was just part of their life, “Here’s what you do, oh,” or “here’s how you struggle,” or “oh, here’s the story about how I figured out how to take notes or I figured out what my major was going to be,” …any of those things. I had no idea that those obstacles even were laying ahead of me. I had succeeded in high school, but I had done that, I think, just through brute force method. I put in the hours studying, I didn’t know how to study, but I put them in, and I did well. I had very lame interpersonal skills with the teachers, but they were a little bit less lame than the other students at my school. Together that allowed me to get through and even to get the message, “Hey, you’re okay, you’ve got it figured out. College might be harder, but just use more of the same.” And I at least now I think coming from that perspective, it makes it a little bit easier for me to get inside my students’ heads and realize the struggles that they’re maybe going to have. Terry talks about sitting in the back of the classroom and vandalizing the desks. For me, I wish that I had gotten inside the classroom. But the idea that I was somewhere that nobody was checking up on me, I would walk to where the class was, and then I’d hang out outside, I talked to friends or I’d just sit out there, and it was this very empowering act that I was in charge. And that for me led to most of the problems that I wasn’t even in the classroom. And I had this idea then that the teacher was just going to smash me down to show me that they were in charge or something like that. It was all misguided, but I think a lot of that came from, as you say, John, that I had no background, this was completely foreign to me. And because of that, it’s hard enough certain obstacles to overcome them when you see them ahead. But when you don’t even know that they are in front of you, it gets really difficult.

Terry: The Secret Syllabus is a Princeton University Press book. So it went out for academic review. And there were a number of comments: “This book should be directed only at first-gen students, because that’s really where the problem is.” And our response was, “It’s probably more important for first-gen students if they’re able to understand it and we’ve written it in a way that they can use it.” So I have three daughters, one is a freshman in college, and the other two are, one’s in high school, one’s in middle school, and they get the knowledge from The Secret Syllabus directly from me. Now they don’t listen very often to that, but they at least have around them all the time both explicitly, like “how would you interact with your teacher on this topic?” And then in the air, in the gestalt of “how do I interact with the pediatrician?” and so forth. And so if you’re not in a household like that who knows how to navigate this world, where are you going to get the information? Well, one answer we hope, if we’ve done our job, is The Secret Syllabus. So even though it’s not explicitly targeted only for first-gen students, I think it actually has more use to a first gen student who doesn’t have access to a family member or a friend who knows the secret rules.

Jay: If I could add one thing, also the students, yes, who are not the first-gen students, or who have a world of experience college graduates around them, sometimes that sort of turns out to be a negative, because they might imagine that they’ve gotten the message “Oh, I don’t need this.” And in a lot of cases, it’s like, “Oh, yeah, Secret Syllabus. Yeah, something like that would be great for the remedial students.” And I think “what do you mean, the remedial students? You took when you were in high school, or even your first year of college, you took chemistry or history or English, or whatever, but who taught you how to study? Who taught you how to make a to-do list? Who taught you how to develop long-term career goals? Who taught you how to just plan your time?” all these different things, how to develop professional relationships, and a lot of these students who maybe have tons of advantages that causes them not even to realize that there is this whole secret syllabus of other stuff that they have no training in whatsoever. So they needed just as much.

Rebecca: I would actually recommend it as reading for faculty and administrators. Because when I was reading it, like yes, I actually knew these things. But like, I don’t typically explicitly state all the things because it’s the hidden syllabus [LAUGHTER] …these are all things that if we’re a part of the Academy, we have learned over time, but we don’t actually typically articulate necessarily or make explicit to others. And so reading this was like, “right, yes, of course, that is a rule that nobody knows about.” And so I could see a real advantage to having a faculty reading group, for example, around this book just to get insight into the missteps that students make simply because they’re not aware, and again around for administrators who may be in similar situations, like, thinking about policy, or easily blaming students, or easily blaming faculty for something, and just becoming more aware of all the unwritten rules around the academy seems really beneficial.

Terry: Amen.

Jay: That reminds me of a term that my wife, Julia, she’s an educational researcher, she knows all the official terms for everything, but expert blind spot; that you get so good at something that you don’t even realize that you know it or that you’re doing it. And it helps if you’re talking with other people, you can see it in them and at least call it out. So you’re right, you have a reading group, and you’re like, “oh, yeah, we do know that.” Or “we do have that whatever practice that we haven’t told people about.”

John: One of the things you describe early in the book is sitting in the back of the classroom, feeling completely disconnected from the experiences that the professor was describing. And you also talk a lot about how students come in for office hours and ask questions that faculty find really annoying when the students are really just trying to get some help and they don’t know how to phrase it. They’ll come in and ask questions like, “I really don’t understand the material we’ve been talking about for the last two weeks. Could you explain it to me?” [LAUGHTER]

John: And it’s really frustrating for us, but clearly the students are reaching out. And reading your book reminded me a little bit about how they must feel in these types of circumstances where they’re feeling a little bit awkward asking these questions. They really would like some help, but they don’t quite know how to phrase it. And I think part of our responsibility is to help bridge that gap a bit. And reading your book, I think, as Rebecca said, would be really helpful for that.

Jay: That’s funny, I always laugh when someone will say that, “Oh, I miss class. Can you just quickly tell me what happened?” I’m like, “If there was a quick way to do it, class would have been quick, then we would have been done.” [LAUGHTER] But you’re right, though, you have to immediately stop yourself from mocking them or looking down and think, “this person actually just came to me, they want some help.” So office hours is an unusual thing. And full disclosure, I only have experience with it as a faculty member, because the total number of times I went as a student: zero, and I regret that very much. But as I was going through college and struggling, so many people would even say, “well, you got to go to office hours,” I would think to myself, “okay, I hear you. I’ve heard lots of people say that.” But in my mind, I thought, “well, it’s okay. I know I have the textbook. I can read it or someone’s notes. So I’m okay.” Because I was making this assumption that office hours was for me to say, “could you re-explain everything about photosynthesis again?” Or “could you solve this problem?” Terry always makes me laugh about the student who comes into the office and says, “I need help with problem number three, and number seven, and 11 and 14 and 21 and 22. Can you redo those?” And they sit there and I think, “okay, yes, we do know the answer to those. And that is something that can be done in office hours.” But the insight… that it took me about 20 years to have… is that office hours is the first time, maybe the only time, where you as the student control the agenda. You are able to talk about anything that you think is relevant. And for that reason, yes, you can have them re-explain a concept, except that there’s Khan Academy, and there’s videos and there are textbooks, and there are other people and there might be a teaching assistant for the class, that might not be the best use of the time, because you have alternative ways. On the other hand, you’ve got this instructor here who has some insights that could really help you. And we try to give very concrete examples of things you as a student could ask. You could say some questions designed to help you be a better student… ask something like, “hey, if you were a student in this class, how would you spend your study time?” Or “you’ve had a lot of students, if you could change students in one way, what would it be?” Or if it gets close to the exam time, you could say, “to you, what are the elements of an ideal exam question?” Or “how do you create a lecture?” Or did you struggle ever? Did you always know that you wanted to be a biologist” or an economist or whatever, and you ask these questions, and in my office hours, which is usually a group of people, they be around and most students are like, “wow, this is really good and unexpected… the conversation we have helping them with professional development” or whatever. There are always a couple students who let out these heavy sighs, like, “ugh” because they have their list of 26 questions they want you to restate. And I have to usually directly address them and say, “I can do those. But this is actually some useful information that you’re not going to be able to get anywhere else, and might help you out, so think about that.” And I’ve even started now, in class, I’ll say, “hey, in my five years as an undergrad, I went to office hours zero times, you should just go even if you have nothing to say, just listen, just come and say hi, and you can leave” that I think has lowered the threshold a little and I get a bunch of students they come they say “hi,” they stay for a few minutes, and they realize, “oh yeah, this isn’t just a cram session” or something like that.

John: And once they come that first time, they’re much more likely to come up to you other times and ask questions in the hallway or just stop by for brief visits. And it makes it a much more pleasant interaction, I think, for everybody.

Jay: Yeah, they realize that you’re human, you’re a regular person, that you like to laugh, you have outside of class things that you can talk about. And that really does, I think, demystify who you are, and maybe what motivates you and other things that are relevant.

Rebecca: One of the things that’s really interesting, I think about this particular book is that we often deal out advice to students all the time that’s kind of generic and probably not that helpful. But when you really think, it’s like, “you need to manage your time better, you need to study more, you need to whatever the thing is,” without much explanation. Can you talk about some of the examples of maybe bad advice that students receive and how maybe you’ve addressed and provided a different kind of advice in this book?

Terry: Well, the office hours one is an obvious example. But we already talked about that. So it’s probably not the best example to continue on. I might say, I don’t know if it directly addresses what you said, but if the student and faculty member, or instructor, can have a relationship, professional relationship, as opposed to a transactional view, that’s a better solution. So I’ll give one cautionary story, which will make me sound really mean. And then I’ll tell you another story. So the mean story is I have a student come and he says, “I’ll talk about my grade on my presentation.” I’m like, “well, do you want to learn how to do a better presentation or do you want a better grade?” “Uh, kind of both.” So he just wants a better grade, but he’s kind of mealy mouthed about it. So he sits there for 11 minutes and goes through it. And then as he’s leaving, he asks, “oh, and is there any chance to get a job?” and I’ve gotten hundreds of people jobs, life-changing jobs, and I said “just took 11 minutes of my time, I could have gotten your job in those 11 minutes.” But he goes, “what about now?” I said, “no, you had your time. Get out.” So conversely, I had another student who used to just come by and chat with me. And we would talk about anything but the class. And I remember he bought me, this was years ago, an Austin Powers lifesize mannequin to put in my office with a frilly cravat. And then towards the end of the semester, another faculty called me and said, “Oh, you know, this person is in trouble in this stats class, what do you think?” and I said, “I think they’re an excellent person, that they are really trying hard. And I would give them the benefit of the doubt.” And so I don’t think explicitly, the student was doing anything to try to manipulate me, but because he came by and talked to me, and I got to know him a little bit. Interestingly, he’s running for Senate… in an important race. I won’t say his name, but he’s running for Senate next week, the same person, so his effective techniques for interacting with people…. So I don’t think bad advice people give you, it is just not advice that you get. And when you treat the person transactionally, then they treat you transactionally. And so if the faculty member is a fair and honest person, you’re going to get whatever you deserve as a student from them, they’re going to look at your grade, I’m going to talk to my student about his 8 out of 10 on the presentation, but you’re not going to get the next level relationship benefits, which can extend to the career and so forth if you go down that path.

Jay: Something that I’d like to add to that… when Terry and I first wrote our book, Mean Genes, people would read it, and they’d be all excited about it. And they’d come to us, and they’d say, “you guys should be on Oprah.” And that was their advice to us about “here’s what you should do. Because I know you’re trying to sell books, you should be on Oprah.” We’re like, “Oh, let me write that down.” And you see advice like that in books, oftentimes, where it’s well intentioned, and it’s actually accurate… we should have been on Oprah. But it wasn’t helpful, because it’s like someone saying you should go to office hours, they’ve already heard that. You have to tell them why should they go to office hours. What are the questions they should ask? Or someone says, “you should get a faculty mentor.” Okay, they know that, but how should they do that? And I think that oftentimes, you’ll also see in these books where they start doling out advice, that it’s just patently offensive, because it’s so obvious. Get to class early, be prepared, read the assigned material, try not to cram for tests, avoid procrastination. You might think then that alright, whatever, that’s harmless… that advice, but I feel like advice like that actually does extract a cost because you’ve only got so many words in a book and you’re either going to convince someone, maybe someone who’s reading Strunk and White, how to be a better writer, and it’s this very concise, precise book, so you get the message. But if the message is buried within stuff that the person thinks is obvious, they’re likely to put it down, or they’re likely not to trust you as much as the author because clearly, you don’t understand the reader if you think that they need to be told “avoid procrastination.” We all know that. That was a big part of our goal in writing the book. We didn’t want it to be a giant book filled with either obvious stuff or not helpful stuff. We wanted it to be a high density of material.

John: One of the things you talk about along these lines in terms of providing tips that may be different from the advice a student’s had is in terms of planning your pathway through college, because you note a lot of students are told they should pick a major early, focus on that, and work very quickly towards that goal as efficiently as possible and get their Gen Ed out of the way, and so forth. Your advice is a bit different. Could you talk a little bit about some of the advice that you recommend concerning what types of classes students should take and how they should plan their career in college?

Jay: As students are making their way from high school to college, we’ve seen this common pattern where someone will have, I don’t know, maybe when they were in fifth grade, thought, “Oh, what are my options when I grew up? I could be an astronaut or I could be a racecar driver or a pop star or professional athlete or a doctor. And if you happen to hit on Doctor, which is maybe the only realistic hope among those for most kids, your family responds better, like, “Oh, yes, very good.” And as the kid who it’s nice to have, it seemed like your family now loves you slightly more than they used to, that seems great. And then you start to stick with it, “Oh, yeah.” And then I get these students, they’re at college, and there may be a first year and they’ll say to me, “I’ve wanted to be a cardiothoracic surgeon since I was 10.” They want that to convey their commitment to it and their maturity and all that. But all I can think of is “do you really want to let a 10- year old make this most important decision of your professional life?” I think that maybe you should come to college with a more open mind, because when you were 10, you didn’t know all the options. If you look at these lists, and anytime there are published lists of job satisfaction, I love going through them because all the top things on job satisfaction, you’ve never even heard of as a 10-year old, or even as a college freshman, whether it’s software quality assurance engineer, or physical therapy director, or risk manager or security director, whatever. So from that, it’s caused us to realize that it shouldn’t be a race… who can identify their career goal first? …and then have them make other students feel bad because they’ve gotten to college and they can’t articulate it. It’s like, “oh, what do you want to do?” And the other person just talked about all these great things they want to do. And you’re like, “I don’t know, it sounds like you’re behind. It sounds like you’re worse off,” except that when you get to college, you don’t know what linguistics is, or applied math, or anthropology, or in many cases, psychology, or these majors that are huge, rich worlds that might interest you. So we want to encourage students to resist that temptation to have a plan. Because it seems so good, because everyone is so relieved and happy. But instead, you can’t just be passive, you have to explore the options that are open to you. That’s part of what you should be doing there. You have to learn about possible career paths, you have to investigate fields that might be of interest to you, you have to reflect on what is it that makes you happy? And what is it that stresses you out, maybe not in as good a way? …and that should be your plan because if you can’t explore things in college, then when do you get to explore? You stick to your 10-year old dream, and then you have the midlife crisis at 35 when it’s much harder to change your plan. And I think that message has not gotten out as much. Often students will even say to me when I say don’t worry about articulating a plan, but be active in exploring it. And I say, “you might have been experiencing parental pressure for a long time.” And they’re like, “oh, no, no, I haven’t at all. My parents are actually really chill about what I do.” I have to respond, “your parents are chill about what you do, because you’re still a biology major and that’s what you were when you came in. And you’ve articulated the same plan. The only way you’ll know if they’re chill is I want you to send them an email or call them today and say, “Hey, I’m changing my major to English,” then see if they are, because you may have been responding to subconscious signals about how much they love you when you have a plan versus not having a plan. And if we could get that message out that this is the time to learn about what you like and who you are, and that you might be becoming a different person than you were when you were younger.” That has a lot of value, I think.

Terry: So I invite my alumni to come back. I teach at Chapman now, and I have all these students who have graduated and have good jobs. And one semester, one of my students said, “I’m going to come back and I will talk to you students and I want to go to lunch with them. I want to interview them and I want to hire some of them.” So I tell my students “here it is, this great opportunity. The firm is local, if you want to live in Southern California. They pay well. The person who’s coming graduated four years ago. You want a connection with somebody who’s not remote from you? What could be better?” I said it’s only going to be room at the lunch for six people. So sign up and I’ll randomize publicly who gets the sixth slot.” So the person comes, Alan, and I go to do the randomization in front of all the students. There’s 70 students in the class. I look at the list, the sign up list, there are three people on the list. So all three of them go to lunch. And one of the kids, Mitchell, I just invited him back. I gave a talk to all the new Chapman students, all 2000 of them. And I invited him as the guest speaker to talk about this story. He comes. And I said, “why are you here?” And he goes, “I’m not even interested in real estate finance, but I just thought it was a great opportunity to learn something and come to lunch and talk to somebody.” He now works for that firm since that lunch. He got an interview, he got an internship, he loved it. And now he loves his job there. And it’s just hilarious that people miss this opportunity. And then again, showing my mean side, [LAUGHTER] a year later another kid writes me and he said, “I was in that same class. And now I want a job with that company. I’m interviewing with them. Can you connect me?” And I’m like, “no, you had your chance to connect.” I mean, of course, I didn’t say no, but the reality was, it’s much less effective to connect when you want something than when you’re just going to go learn something. So you have to look for those opportunities. In my own case, I was riding my bike through Harvard yard when I was in grad school on my way to a microeconomics review session. And I saw a poster for a talk by Caltech professor Charlie Plott. And I thought it looked really interesting. It was about experimental economics. I’d never heard of the field before. I’m like, “Okay, I don’t know what this is. I’m probably going to get a worse grade on my micro test, but I’m going to go to this talk by Charlie Plott.” And I went and was like, “Wow, I didn’t know any of this stuff.” And then I ended up doing my PhD with another experimental economist, Vernon Smith, and how I ended up at Chapman and I did get a worse grade on the test too.

Rebecca: You want all the things [LAUGHTER].

Jay: Can I add one other story that Terry has told me about one of his students who came in wanting to be a doctor, and was all excited that he was able to get this internship shadowing a doctor. And he goes, it was an orthopedic surgeon, and he gets to go, follow her around, even go into the surgery, theater, and all that. And what he discovered was, even though she loved her job, she was great at it, he was bored to tears. He thought, “Oh, my God, this would not be good at all.” And in some ways that felt like a failure, like, “oh, no, I don’t like what I’ve picked.” But in other ways, think about the cost of realizing that now when you’re in college and the cost of realizing that when you are in your fourth year of medical school or you are 10 years into your career. So the idea of exploring also carries with it that you’re not just trying to get the things to add onto your resume. You’re exploring because you’re going to find some things you don’t like, and it’s low cost to get to rule them out at the earlier age. So people don’t always realize that, that trying something out might give you information about what you don’t want to do. And that that has maybe as much value as finding out what you do want to do.

Terry: Right. So here’s something else that’s interesting. These people that we’re talking about are not made up things, this is a real story. So that person who Jay just talked about who was my student, who wanted to be a surgeon, here’s his most recent posts from LinkedIn, he now works as a product manager in London. He literally just posted this “when I was 10, I thought that my goal in life was to shoot for the stars. But today I understand my destiny is to come into the office today, every day for the rest of my life. Why do I say that? Because I came into the office this morning, and it was the best feeling in the world.”

Jay: That’s so great.

Terry: Isn’t it? I just looked them up while you were talking, Jay. And yeah, they’re all real people. And these are real stories. And we have hundreds of them that we draw from to synthesize the themes there. And that theme is very clear, which is, for most people, picking your job when you’re young and sticking to it is a bad decision. And if you’re talented, there’s so many different things you can do in the world. I had another friend, which was funny, he was a very talented guy too. And he said he realized when he was about 25, he didn’t want to be anyone’s boss. He didn’t want to have a boss. So he end up becoming a journalist, one you’ve seen on TV many times, but he was like, you don’t know those things when you’re 10. He didn’t know that at 10, he figured out when he was 25. Like, “this is gross. I hate giving performance reviews. This is terrible, even worse to give them than it is to get them.”

Rebecca: Another thing I really like about your book is these stories that you include, and that they are based in reality. And it’s a nice way to bring students into the conversation. And a lot of the stories have this thread of needing relationships [LAUGHTER] or a chapter on seeking out good teachers when you’re choosing your classes. And a lot of times those good teachers lead to good mentors in other things. And as you’re telling these stories, I’m thinking about the internship that I went on that I discovered what I didn’t want to do, or the mentor who told me I should take advantage of some of those opportunities that I probably wouldn’t have done had I been left to my own devices without a little bit of nudging.

Terry: So what was it that you didn’t want to do?

Rebecca: Well, interestingly enough, I didn’t want to be a graphic designer in the traditional sense. I do teach in a graphic design program. But what I discovered is I wanted to do more experience design and interaction design, which I hadn’t really been exposed to. I didn’t want to do marketing and branding, which is what the internship was. I hated it. I hated every second of it.

Terry: And when you changed your mind, was it difficult internally or externally to change what you want to do and have to tell everyone a different story?

Rebecca: Yeah, I mean, I think the first thing afterwards, it was like, “I’m quitting this major.” I actually ended up finishing it. But I ended up curating some of the other experiences around it in a different way. Because at first I thought I was gonna have a graphic design major, and I was gonna have a business minor. This is what many students have this combination of things. And I quickly discovered that wasn’t going to work for me and I needed to explore some other things. And I went more on an exploratory path for a while to figure out some other things, really in a field that was just starting to come into being.

Terry: Yeah, and did it feel bad, though? Now it sounds cool. Like, I went exploratory and it felt okay then?

Rebecca: No, it was really nerve racking and I was really stressed out and I tried to go to the counseling center and I talked to every mentor I had about how it was having a crisis. I mean, it felt really bad initially. [LAUGHTER]

Terry: We also tell three stories in The Secret Syllabus of people who found their passion early and stuck to it and then were very successful in an area, Steven Jobs among them. And the myth that they project is that you’re a loser if you don’t know what to do when you’re young. And they have this idealistic: “there’s one job for you, there’s one passion for you.” And that is not true for most people. And it’s a destructive myth out there. Most people are more like your experience, Rebecca, or my student, where you’re not sure. And if you’re introspective, you learn and you find something different.

Jay: I think, as an instructor, and as a parent, and just as a grown up in the world it’s very hard to internalize the message that Terry just said, which is that something inside of us when we meet a kid who says, “Oh, I’m applying for college,” or “I just started college,” we ask questions like, “Oh, what do you want to study?” These are questions that I think can subconsciously convey the message that if you have a plan, it’s slightly better than if you didn’t have a plan. So you have to really undo that and ask more about what kinds of things interest you or as you were saying, Rebecca, [LAUGHTER] when you describe something that was a bad experience, I find that if I ask people: “Tell me about your worst job experience,” or ask students “tell me about your worst classroom experience,” that can be more educational than hearing 100 stories about someone who saw the path illuminated and followed it and now enjoys success. If we can shape discussions in that direction more, it can really help a lot of students who I think don’t want to acknowledge that they’re not sure or they don’t have a plan.

Rebecca: I recently had a conversation with a colleague about a conversation she had with a student that she was mentoring. And the conversation went something like this, “I can’t wait to meet your parents at graduation.” And the student says, “my parents definitely are not going to be excited to meet you.” We were talking about this and how that really reveals how there’s a disconnect about the pressures that might be happening at home or from other sources that are happening to a student that aren’t always visible to us as faculty or mentors. There’s so many other things going on. So although you may have convinced the student of a particular thing or suggested they do this activity, or maybe you’ve helped them discover a new major or something that might suit their passions, they’re also having this internal dialogue with themselves about how am I going to break this to my parents or whatever needs to happen. But I just thought that conversation we had this week was so enlightening.

Jay: I love that because I was finishing my PhD, and after having struggled for years and years, and really things were touch and go all the way till the end, I’m getting my PhD at Harvard, and my parents come, and neither of them had been on a plane before I went to college. And they come now to Harvard. And I’m feeling all great about this. And just as I’ve gotten the diploma, my mom says to me, “Do you think you could get into medical school now?” …and she was still clinging to this idea of when I was maybe in grade school that I could be a doctor because then that would have some job security and respect or whatever. And so if I’m not a doctor, it must be because I couldn’t get in and maybe the Harvard PhD will help. And I had to tell her like, “I don’t want to be a doctor.”

Terry: And Jay, did you know that I got into medical school?

Jay: I did know that. I can only imagine the pressure because I know your dad. Yes. That’s just brutal. If my parents heard that I had gotten into medical school and didn’t go, the disappointment would have been overwhelming.

Terry: I had an excellent job as a busboy in one of the finest restaurants in La Jolla that I went to instead of going to medical school.

John: For many years, I taught in a program for gifted high school students at Duke University in the summers. And at the end of the term, we met with parents and many of the parents had very definite career plans for their 15- or 16-year old children. And they typically asked, “do you think our son or daughter has a future in,” I was teaching economics classes, “in economics?” And I’d say “clearly, they’re doing very well at this and it’s one of many things that I’m sure they could be very good at.” What I normally would say is, “over half of the students who enter college change their major within the first couple of years.” And what I’d recommend is that they explore as many different courses as they could now and when they go into college, and parents who didn’t generally like that advice very much. As you’re talking, I was thinking of two of my former students who I’ve known, now twenty-some years later, one of them actually was one of the best students I ever had in an economics class. Then he ended up at Stanford, he changed his major to religious studies and as he put it, “path of least resistance,” and he became a musician, and he’s a very, very successful musician today. Another student, his parents had plans for him for medical school, and he was on a Freakonomics podcast because he’s now an economist who’s become an expert in some interesting areas in economics. And they didn’t intend for him to go on in economics, he was clearly ending up in medical school.

Rebecca: I’m wondering if a good audience for your book is parents. [LAUGHTER]

Jay: Possibly not, I have sometimes thought about that. I might, if they saw me in class, wearing a nice shirt and tie and I looked very formal about the whole thing. I might be the most dangerous, subversive element in their life, because I’m the one telling their kid your parents already had the chance to live their life, you get to decide now. If they truly believe that you are wise and mature and smart, as they say they do, they should trust you to make good decisions. But it does feel like yeah, the parents… in the long run, they might… but in the short run, they might fear this kind of thing because parents want the best. And sometimes that means a little bit of risk aversion.

Terry: I would say I am a terrible parent. [LAUGHTER] So I have three daughters. Two of them are sort of introverted, and one is super extroverted. And I’m always nervous about the extroverted one, even though she’d probably be very good at navigating the world. But I asked her today, I was driving her to school today, and I asked her, “do you ever read your history textbook?” She said, “Absolutely not. It’s so boring.” I’m like, “yeah, it is boring. The content is good, but presentation is terrible.” Yes, so once you study hard, and don’t go out very much. I’m like, Yes, things are gonna work out okay for them. And then my middle daughter who’s doing well and super outgoing and loves to talk to people. I’m just nervous about the downside for her. So I see the attraction of neurology or being a was it, Jay, a…?

Jay: [LAUGHTER] A cardiothoracic surgeon? Yes, they don’t even know what that is. [LAUGHTER] I should validate. Yes, Terry is a terrible parent.

Terry: Yes.

Jay: And yes, his daughter is starting at Stanford this year. So that kind of terribleness.

Terry: One of the introverts?

Jay: Yes. [LAUGHTER]

Terry: The extrovert’s not going there, except to visit. [LAUGHTER]

John: You mentioned boring history books, one of the things that I really enjoyed about your book was how powerful the narratives are in it. And I think that’s something that perhaps we could all use when we’re writing books about our disciplines, or when we’re teaching these subjects, because storytelling seems to be really an important way of communicating information, and we don’t always use that in our classes.

Terry: It’s a failure of our ability to understand other people. So one of things I laugh about is, when I have my students comment on other students’ presentations, they are very good at finding the problems. And the problems are always exactly what you said, not enough storytelling, no eye contact, not engaging, not straightforward, not humorous. And so it’s easy for us to critique somebody else. But then when you’re doing the presentation, it’s hard. And if you do it for a long time, you get better at it. But your first instinct is not to tell stories, it’s to get the facts and get all the data. So I’ll tell you another story. So I had a student come back, Chad, he was the first Chapman student of mine to work at Goldman Sachs. And he came back to talk to my students. So I coached him before. And I said, “Chad, this is what you want to do. You want to tell a story. And then you want to tell a message.” And it came up and he was shy, even though he was now working at Goldman. And he told some stories, but he didn’t really do it in the way that I thought he should do it. So he told the story, which was funny, he said “at Goldman, everybody uses Excel all the time. But you’re not allowed to use the mouse because the mouse is slower than the keystrokes. And because you’re in this financial factory, it’s important to work as fast as possible,” and his boss would sit behind it and yell at him. “Don’t touch that mouse. Don’t touch it.” Overall I said, “Thank you for coming. I think you could still work, do a better job on your presentation skills.” The end of the year, I’ve given 36 brilliant lectures, [LAUGHTER] and I asked the students in the formal reviews, what was the best part of the class? Half of them said Chad’s presentation… [LAUGHTER] which was entirely story based, and God, I’m just the dumbest person in the world. People love stories.

Jay: I completely agree. And I think that’s what Terry and I bonded over in our very first first teaching experiences. I got asked to apply for some award at UCLA, but part of it was I had to write a teaching philosophy. So I thought, “alright, I’ve been here for a little while, I’m gonna write it down.” And I started listing all this stuff. And later on, I thought, and someone said, “you should try and publish this just in a teaching journal, all these ideas about teaching.” So I do, and I find the references for everything. So everything I do, if it’s about take-home messages, here’s the research that shows this is good. If I do this, here’s the research for this. And I had 10 of these things that were going to help people be better teachers. And the last one, I’m like, “I don’t have any evidence for this, but I just know that it’s good.” And it was “you got to tell stories, you have to reveal stuff about your own personal life, you have to somehow bind the material, the ideas, to your students’ lives.” And just as I was about to submit it, someone says, “I just heard the phrase ‘self disclosure’.” And I just hadn’t looked for that literature, because I’m not an education researcher. And I look and there’s a whole world and thank God all the evidence says that the extent to which you’re telling stories about your own life in ways that are meted out in the proper magnitude and that they are relevant to the stuff you’re talking about. It’s hugely successful. That is what the students remember. And so as long as you can do that, I think, yeah, Chad’s story, “use the keystrokes.” Every time, you can come up with an idea from your own life, if you can make it clear, so the student is going to be able to construct the knowledge later on in their own head, why they were saying that, that’s a huge win for the teacher.

Terry: So I tried this, I try to copy Jay’s stories. [LAUGHTER] So one of my early teaching experiences was Jay was the head teaching fellow for this biology course known as “Sex at Harvard.” And he would give his class, his section on Wednesdays, and I gave them mine on Thursdays. So it was the first time teaching it, and he had done it for many years and was great at it. And so I went to his section on Wednesdays, I took notes, and I would try to replicate. So he would tell these anecdotes, which every time would backfire for me. So I’ll tell the one, the one he is talking about stabilizing selection, why babies can’t be too small or too big, too small, because they’re not viable or too big, because pre-Caesarian you can’t get out of a mother. So he tells the story. “Oh, my brother Patrick, he weighed 13 pounds at birth. But now he weighs 600 pounds. No, he’s perfectly normal size.” So I try that anecdote the next day. Now, it’s saying it’s my brother, Patrick. And a very large person says I was kind of a big baby too. [LAUGHTER] And I’m like, “okay, be careful on the self disclosure.” So, it didn’t go well, anyway, stories, yes, they’re the best. You can’t forget them, right? You’ll never forget that Jay’s brother weighs 13 pounds.

Jay: [LAUGHTER] It is true, and he is normal size now.

Rebecca: We usually wrap up with the question: “What’s next?”

Jay: I’ll say what’s next for me. When I first got into teaching, I thought, “Oh, I get bored of things fast. I’ll do it for a couple of years, and then I’ll move on.” But it turns out that I’m endlessly fascinated by it. Because in order to improve, there is an almost infinite number of things that you can do. So for me, right now, I’m thinking a lot about the pandemic, in many ways, was just this horrible thing if you were a teacher, but we had these constraints that in a few cases, caused people, including me, to discover, “Oh, this is actually useful.” So for instance, the discussion window, and I would have these students who never in a million years would have raised their hands or spoke in class, and they’re typing stuff in the discussion. And other people are responding and they’re engaging. And I thought, “Wow, this is good. That’s what I would have done.” So I’m trying to figure out how to take the various things I learned from teaching in the pandemic. So how can I incorporate a chat window in class so that I get the same effect or things like these just richer learning activities, I had a lot of assignments where they had to go out with a camera and take a picture, just of something and talk about how it was relevant to whatever the lesson was, or these discussion boards were, instead of turning in a paper, they had to post it, and then everyone else got to comment on it. So suddenly, we had this community. So I feel like right now I’m trying not to return to some bad habits from teaching, but instead to say, “Wait, I have ways that I could be better.” So that’s sort of my hope, is that I’m very slow at incorporating new innovations, but I’m a steamroller. So if I could just figure out a few ways to get better now based on those experiences, I’d be happy.

Terry: And for me, Jay and I, our first project together was the book called Mean Genes, which we call a Darwinian self-improvement book. So how to be a better, more effective, happier person by understanding natural selection, biology, etc. And I still think about that all the time. So you probably know this famous 1973 study, to survey people’s self-reported happiness who win lotteries and other people who become permanently physically disabled because of accidents. And you survey their self-reported happiness and after about six months, they get very close back to where they were before the incident. Now, you don’t have the same people, There are methodological issues. But that notion makes sense from an evolutionary point of view, it’s probably the most important chapter in Mean Genes. And it’s to me the most important notion for your own life, which is that the setbacks aren’t permanent. Jay’s a steamroller. And things that seem like they’re terrible, they may very well be terrible, but your ability to recover from them is probably greater than you think at the time. And so for myself, as I said, I’m a terrible parent, I’m always initially disappointed if my kids aren’t brave, and they don’t do the hardest thing first. And I try to do the hardest thing first, every day, because it’s surprising. And the other day, I thought, we had rats in our garage, because we had rat poo in our garage. And so it depressed me, like this is just a horrible thing. So I got up early, I took every single thing out of the garage, I had the exterminator come, and six hours later, I find out there are no rats in the garage, he could tell immediately, it was at a minimum of 12-months old, and my garage was completely reorganized. So literally, from the time that I was the most depressed about my house that I had been in years to the time when I was happiest about my house was about six hours. And it came from not hiding from the rat poo, from addressing it. So what’s next for me is to continue investigation of human nature, how to do things along the lines that we talked about in The Secret Syllabus and in Mean Genes, which is how to make realistic changes in your life, to be a better person for yourself and for the people that you care about.

Rebecca: Well, thank you so much for joining us. I really hope that a lot of first-year seminars and other kinds of opportunities to get this book into students’ hands will happen.

Terry: Well, thank you. Thank you for having this podcast and for having us on.

Jay: Yes, I concur. Thank you very much. It’s been a lot of fun.

John: Thank you. It’s a great book.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

261. Social Justice Assessments

Traditional methods of assessing student learning favor those students that reside in well-resourced school districts while leaving low-income students at a substantial disadvantage. These grading systems also encourage students to focus on their grades rather than on their learning. In this episode, Judith Littlejohn, Meghanne Freivald, and Katelyn Prager join us to discuss a variety of social justice assessment techniques that can help to create a more equitable environment in which all students can be successful.

Judie is the Director of Online Learning at SUNY Genesee Community College, Meghanne is an Instructional Technology Specialist at Alfred University, and Katelyn is an Assistant Professor in the English Department at the Fashion Institute of Technology.  Judie, Meghan, and Katelyn worked together on a SUNY Faculty Advisory Council on Teaching and Technology committee on social justice assessments.

Show Notes

Transcript

John: Traditional methods of assessing student learning favor those students that reside in well-resourced school districts while leaving low-income students at a substantial disadvantage. These grading systems also encourage students to focus on their grades rather than on their learning. In this episode, we explore a variety of social justice assessment techniques that can create a more equitable environment in which all students can be successful.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

Rebecca: Our guests today are Judith Littlejohn, Meghanne Freivald, and Katelyn Prager. Judie is the Director of Online Learning at SUNY Genesee Community College, Meghanne is an Instructional Technology Specialist at Alfred University, and Katelyn is an Assistant Professor in the English Department at the Fashion Institute of Technology. Judie, Meghan, and Katelyn worked together on a SUNY Faculty Advisory Council on Teaching and Technology committee on social justice assessments. Welcome Meghanne and Katelyn and welcome back, Judie.

Meghanne: Thank you.

Katelyn: Thank you.

Judie: Thank you.

John: Today’s teas are:

Judie: …I have Lady Grey.

Rebecca: That’s a good one…

Judie: …In my DTL mug.

John: …a nice Desire to Learn mug.

Meghanne: I have iced green.

Rebecca: And Katelyn, how about you?

Katelyn: Mine’s water right now, if it were the evening, I would have one bag of peppermint and one bag of chamomile together, delicious.

Rebecca: Sounds nice and calming.

Rebecca: I have hot cinnamon spice tea.

John: And I have black raspberry green tea.

Rebecca: We’ve invited you here today to discuss your work on social justice assessment. Perhaps, we can start with a discussion on what you mean by social justice assessment.

Judie: So social justice assessment considers factors such as race, culture, language proficiency, socioeconomic status, and ability while working to dismantle systems of power, bias, and oppression in evaluation of student learning. So various approaches including equitable assessment, labor based grading, and ungrading, as they relate to the purpose, process, wording, and structure of student learning assessments are included. So we’re trying to focus on the learning that our diverse students achieve as it relates to specific learning outcomes just to mitigate the influence of dominant norms on our students’ grades. So we’ve all been working together for the last couple of years on a SUNY task group that was part of the Faculty Advisory Council on Teaching and Technology, which I chair. So we’re a subcommittee of an Innovations in Assessment group, and there’s a couple more of us who couldn’t make it today, but we’ve been a really close-knit group, I think, working together for over two years. And we really enjoyed the project, which resulted in a website with all these artifacts on it that people will be able to access. And we’re hoping down the road that we can continue our work, but we’ll get to that later on in this conversation.

John: And we’ll share a link to the overall website as well as your group-specific component of that in the show notes. So this was partly implied in your response defining social justice assessment, but, what are some of the shortcomings of traditional grading systems in terms of equity?

Meghanne: When we were doing our research on this topic, we encountered many drawbacks of the traditional types of assessments that we all experienced all the way up through school and into college, and I’ll share a few of them. One is that the focus is often on the grade rather than the actual learning process and what the student will actually be able to do, and be able to learn as a result of engaging in the education process. They just focus on the grade, “what’s my grade?” and that sort of misses the point. It creates a system where students are compared to each other rather than having the focus be on individual growth and achievement. It also can put students at an advantage or disadvantage based on characteristics such as race, ethnicity, socioeconomic status, disability status, language proficiency, and lots of other characteristics that students themselves don’t have any control over. We found in our research that traditional assessments tend to favor white, affluent, high-achieving students, and that really isn’t who most of our students are anymore. So we really need to remove barriers and create a way for students to accurately represent the learning that has taken place.

Rebecca: So you hinted to this in your response about traditional grading systems comparing students to one another. So thinking about that, what role should students play in determining how their learning is assessed?

Katelyn: I’ll tackle that one, and I want to answer it with a disclaimer to start because social justice assessment is an umbrella term that has all of these different strategies that are wrapped up in it, and each of those approaches, whether it’s ungrading, or labor-based grading, might have a slightly different response to that question. They all share the same goal, that students should not be systematically disadvantaged by the assessment mechanisms, and that we want to increase student agency in the classroom. We want students to be active participants in their own learning, but the actual question of how students might participate in determining their own assessments might look very different depending on who you’re talking to and what approach they use. Maybe it’s literally helping design the assessment mechanisms, the grading contract, grading rubric, maybe it’s creating flexible assignments that allow students to determine what learning is being assessed, or in the case of ungrading, maybe it’s just deprioritizing the assessment entirely in order to emphasize the individual student’s learning journey through the course. So I guess my answer, tentatively to your question, is yes, students should be participants in determining how they’re learning is assessed by the big how, and why is going to differ.

John: As you noted, there’s a wide continuum of alternative grading policies that can fit under this category of social justice assessment. Some of them are not that much different than traditional practices, and others are quite a bit different. One approach, which is much closer to the traditional grading systems that people are already using is a system of mastery learning. Could you talk a little bit about what mastery learning is and how that could be used in the classroom to provide a bit more equity.

Judie: So mastery learning is, instead of assessing a student or evaluating a student with one assessment, and giving them that grade, the students are able to go back and revisit the content and work again on any material that they didn’t understand or try things over again. So it’s an iterative process, and they should get some sort of formative feedback in between attempts so that they can understand what it is they need to work on and focus on. And this way, it’s more equitable, because the students are able to take the amount of time that they need to work on the assessment, they can access any review materials that they need to establish their foundational knowledge and continue on. And it just really helps the students learn and grow. And I think it’s a great way to establish foundational knowledge. I use it myself in all the history courses that I teach, and I just think it’s a great process. If you think about it, any athlete, that’s what they do. So if you’re learning how to play baseball, how many hours are spent in a batting cage, or like on the pitcher’s mound, how many times do you try again, and again, and then again, until you are able to do it correctly, or do things accurately? So I always liken it to use that sports analogy, because I really think that helps people understand that students’ learning… you have to practice and you can’t tell somebody something once and expect them to integrate it into all the knowledge they already have, and be able to recall it instantly. So I just think it’s a great way to level the playing field of students so that when you move on to the next part of your content, they all have the same foundation, and they’re ready to go forward.

John: And by explaining it to the students that way, in terms of a sports metaphor, it’s something that they can pretty easily connect to, and I think it also would help to promote a growth mindset, which we know is effective in increasing learning as well.

Rebecca: Another assessment strategy one might use is minimal or light grading that falls under this social justice umbrella, and is a bit different than mastery learning. Can you describe what minimal or light grading is?

Meghanne: Yeah, I’ve seen this described in a couple of different ways. This isn’t something that we really included in a lot of our research, so I kind of looked this up just a little while ago and it’s very interesting. And one approach is more on like the whole course level. And there’s another approach that can be taken on an assignment level. So for an entire course, what an instructor may do is that they would assign assignments throughout the semester, but most of them would not be graded, they would be used as like a conversation piece. And they would be discussed and gone over during class, which would then provide opportunities for the students to seek clarification and for the instructor to provide feedback in the moment. So then the assessment then becomes part of the learning process. So then when there are a small number of assessments that are given for a grade, then when the students get to those assessments, they’re not as intimidating. They’re things that they’ve done with their classmates, they’ve done them with their instructors, they’ve done them in class. So I think it’s a very interesting strategy because it removes a lot of the anxiety that students may have around assessment, because it’s just something that they’ve done in their class. Another take on this that I’ve seen is, on an assignment level, something like a paper, something that may require a lot of revision, where when the professor is grading that assessment, they would maybe not take the time to go through and mark all of the grammar and spelling and mechanical errors, but maybe they would look at a section of that, maybe point out some things the students are doing over and over again, but not mark up the entire paper, but just say, “Okay, these are the things you need to pay attention to that are recurring through your paper.” And then as they read and grade that student’s paper, they focus more on the message that the student is trying to convey and the ideas that they’re sharing, rather than the mechanics and the grammar and the spelling.

John: And one common thing I think, to both mastery learning and minimal light grading is that the goal is to provide students with feedback. In some cases that can be automated. Mastery learning systems involve some degree of automation, sometimes by textbook providers, or perhaps adaptive learning systems, or it could be questions that you put together. But if you’re going to provide feedback on writing, it can require a lot more time. And a minimal light grading approach allows faculty to provide feedback on the most important things without taking up as much time to allow faculty to provide feedback on a wider range of topics, which, again, is I think, to some extent in the same sort of spirit.

Rebecca: Light grading can help not intimidate a student with too much feedback. If you see just a paper completely marked up, it might feel like there’s no possibility for moving forward or revising. But emphasizing what’s most important to change, or most important to focus on can help a student prioritize. And this can be really important to someone new to a discipline who might not know what’s most important.

Katelyn: I’m so glad you said that.

Meghanne: There’s an element of trust there as well, because if we point out what a student needs to focus on mechanically or grammar wise in a small part of that paper, then they can be trusted to then use their judgment to go through it and read it more carefully, and then make those edits based on the feedback that they had received. So it is visually much less intimidating. Plus, it might be a motivating factor for some students too that their professor is trusting them to be in charge of that revision.

John: Another type of social justice assessment involves contract grading. Could one of you talk a little bit about how contract grading fits into this category of social justice assessment?

Katelyn: Sure, I think contract grading is one of those terms that’s gaining some broader popularity and recognition. So it’s probably a term that may be pretty familiar to a lot of instructors at this point. So maybe it doesn’t need a lot of explanation. I’ll just say there’s a couple of different models of contract grading. In some cases, the instructor might provide that contract at the start of the term. In other cases, the instructor and students would be able to negotiate that contract collaboratively together at the start of the term so that students have more of that active stake in the contract itself. Generally, the grading contract would lay out certain requirements which students would need to fulfill to receive their desired grade. And that might include requirements related to attending class or conferences, completing low-stakes assignments, completing major assignments, maybe some page- or process-based requirements. But the bottom line is that the contract gives students a clear picture from day one of the work required by the class so students can look at that contract and know exactly how much work they’re going to need to complete from day one, to get the grade that they really want to receive in the course. I think the additional benefit of contract grading for our conversation is that it decouples grades from assessment so students have more space to take risks in their work rather than aiming for correctness. And on the faculty side, faculty can respond to the content and spirit of the students work as opposed to justifying a grade. I think most important, though, because this system privileges students who are investing the time and effort into their learning, all students have the same potential to earn a high grade in the course regardless of their knowledge or ability with the subject matter prior to the start of the course. So to use another sports metaphor, it works to level the playing field on day one for students who may have very different levels of preparedness and experience with the subject matter.

Rebecca: Another strategy that folks might use, which we’ve certainly talked about quite a bit on this podcast at various times is peer assessment. Can you talk a little bit about what that looks like and how that fits into this social justice model?

Judie: So peer assessment, or I tend to call it peer review, helps to build student investment in writing, and helps the students understand the relationship between their writing and their coursework by helping them engage with the writing in a way that encourages more self reflection and works to help them build their critical thinking skills about their own work. And I think it also helps the students learn from one another, because they’re sort of trying to evaluate their peers’ work against the requirements for the course. But then you also look at your own writing in a new perspective, and you learn from what you’re seeing your peers write and from the feedback that you’re receiving from your peers.

John: Might students perhaps take feedback from their fellow classmates a bit more seriously than they do feedback from their instructors.

Judie: A lot of students self-report that they learn more from this peer review activity, because they’re trying to identify and articulate weaknesses that they’re seeing in their peers’ papers, and also in their own. And I think trying to incorporate feedback from both their peers and their instructor into their own work, I think, just helps raise that awareness and any kind of feedback that’s constructive, as they think about it and reiterate it and rewrite their work. It just helps with their critical thinking. And I think just raise awareness of how they write, and maybe they can be more thoughtful about what they’re writing going forward. I think they also, if they question their peers, say “How did you come up with this?I love this idea,” then they can apply some of this, that they’re learning from their peers to their own work, too. So perhaps that’s what you were getting at John, when you asked that question was, they may benefit more from their classmates telling them how they came up with their ideas than from their instructor just dictating what the expectations are.

Rebecca: I would expand the model to include not just writing but also other creative projects and things. It’s certainly a practice that’s pretty common in the arts, for example, to do peer review of student work.

John: And they also get to see what their peers are doing, which can serve as a positive role model. When students see that other people are doing something that they hadn’t considered doing, it could serve as a way of improving their work.

Katelyn: I think a lot of students come into the classroom thinking of their teacher as the sole reader or audience for their creations throughout the course of this semester. So anytime we can expand those audiences and have students thinking rhetorically about who else might be the consumer of their work. I think that that can benefit our students in really important ways.

Rebecca: It also seems like it’s a good opportunity to formulate community around an activity like that.

Katelyn: Absolutely.

John: One of the other areas you address with this group was the topic of labor-based grading, could you talk a little bit about that?

Meghanne: Yeah, labor-based grading removes the focus from the end product assignment and shifts it to the process of creating that piece of work. So students are provided with feedback throughout the process regarding their labor or the work that they put in. And they’re given opportunities to continue working to improve what they’re producing, and to achieve a desired grade based on a contract sometimes, so there is some overlap with contract grading, but not always. There typically aren’t penalties for students who revise and update their work, because that’s part of the learning process. And it really helps students determine what their end grade may be and how much effort they want to put in, because often, they will be given some sort of guideline for what different grades may be achieved based on certain levels of effort, or certain levels of work that are completed. And also there may be opportunities to grade based on completion rather than more of a subjective sort of qualitative grade.

John: So do you mean like using a light grading or minimal grading where you either completed satisfactorily or you haven’t, and as long as you complete a certain number of assignments or activities, you achieve that grade,

Meghanne: That or also if there’s criteria, like a rubric, and they hit all of the criteria, then they receive full credit.

John: Which becomes, actually, I think, a form of specifications grading.

Rebecca: And then one other model that you’ve talked a little bit about already today is ungrading. Can you expand upon that a little bit more?

Katelyn: Yeah, so ungrading works to deprioritize numerical grades or even attempt to eliminate them entirely. So I hope I’m not speaking out of turn when I say, I think that this is the most controversial of the approaches that we have been researching, it tends to get the most pushback from faculty because it is so different from what we have often been taught or trained to do. So instead of focusing on those numerical grades, instructors are encouraged to focus on providing learner feedback that encourages growth. Okay, I have a quote that is from an ungrading expert I’d like to share. This from Sean Michael Morris and he says, quote, “at the foundation of ungrading, lies something that could change school entirely. A suggestion that ranking and evaluation and the concomitant expertise of the ranker or evaluator is entirely an optional way of viewing things.” And I’m going to end the quote there because I think that that important kernel is that ungrading works to dismantle the hierarchy of the classroom and refocus the attention on individual student learning is an approach that requires a lot of trust between student and instructor, and a lot of student buy-in as well. Students have to be invested in the learning that’s going to happen throughout the course itself. And in a completely ungraded classroom, student grades might be based simply on a final student reflection, or even a one-on-one conversation between teacher and student about the grade that the student has earned. But because ungrading really rejects transactional grading systems, the final grade is more of an afterthought than an important outcome of the course, much less important than learning that’s occurred throughout the semester.

Rebecca: So today, we’re recording on August 9, James Lang posted on Twitter about how deep the system of creating actually is that there’s even things like discounts for insurance, for good students, or good grades. And that it’s really challenging to overcome a system that’s so ingrained beyond just our education system, but into many other systems as well. So I think that that, in part, is why there’s such a strong pushback on this particular method.

John: And we’ve always done it that way, at least for the last century or so.

Rebecca: Change is hard.

Katelyn: Yeah, I think that the traditional grading system is really embedded into not only academia but outside of academia as well. And even within a class that takes an ungrading approach, we still face that question at the end of the semester of “Well, what’s the grade going to be in the system?” because we don’t really have the option, at least at most institutions, to say, “No grade, job well done.” At least at my institution, I still have to put in a letter grade for the student. So we can work to reject that system as much as we can. But at the end of the day, we’re still operating within that same structure. And maybe that’s a question of what’s next, right? Like, are we going to see one day a future where more universities embrace this idea of learning for the sake of learning as opposed to learning for the grade? I don’t know.

John: One of the other things you address on the website is how perhaps the use of authentic assessment or UDL types of assessments might improve equity by providing a more equal playing field for students. Could you talk a little bit about how going beyond the traditional term papers and tests might provide a more equitable way of assessing students’ learning.

Judie: I think anytime you use authentic assessment that helps, or generally it allows the students the opportunity to demonstrate their learning in the way that works best for them. The students are writing a term paper, for example, they can write the paper the traditional way, or they can give a presentation or record a presentation, and still provide their citations and so forth at the end. Or they can do something visual, some sort of a PowerPoint or a nice visual display of the topic and again, cite their sources and explain their images to the group so that people understand how they’re meeting the learning outcome. And I feel like that’s just a good way if people are struggling with language, if people are just struggling with writing in general, I think that this levels the playing field, because it gives everybody an opportunity to really show their knowledge and shine and not just pigeonhole themselves into one more paper or one more multiple choice test, if they have test anxiety. Some of our traditional forms of testing or final assessment just set students up to fail. And allowing students to choose to demonstrate their learning in a way that they’re good at sets them up to succeed. And I think that’s what we really want at the end of the day. And of course UDL principles, those are Universal Design for Learning, and that does include equity in its heart. So that would definitely help to keep things equitable in the classroom. If you’re following UDL.

Rebecca: The multiple forms you were just talking about is a great example. [LAUGHTER]

Judie: Last semester, I had a student who, they’re supposed to do a blog post, and the student instead of writing a blog post, he made a video and he did it three different times. So one is on World War One, one’s on World War Two, and the third one was on revolutions, and so, this student stood in front of a whiteboard, and he had his camera set up so he could film himself. And he had his iPad in his hand. So he talked about a battle, say, for example, and he would draw it out on the board. And then he would show his citation on his iPad. And then he had other citations typed up and taped to the whiteboard. And he went on for 15 minutes, and just was making sure he explained things again, and drew little examples. And he was so animated, and so excited about his topic. And you’re not going to capture that on a written exam, or even in somebody’s written paper. It was just tremendous the way he was able to show all that he had learned and all that he was interested in, and the extra research that he had done, because he felt the freedom to pursue this topic, because he knew he was able to express it the way that suited him the past. And it was just amazing. So I think anytime we can incorporate these things, and I understand that there are times when, according to your creditor, or people have to sometimes sit for a specific certification, it doesn’t always fit, but I think if you can fit this type of assessment in, it is definitely worth it. Because just to see the joy in students when they can explore and expand their knowledge, and then feel confident in demonstrating that to you, it’s just tremendous.

Rebecca: I love the flexibility in demonstrating knowledge and understanding and skill sets because in some of our traditional methods, we are arbitrarily assessing something else. So we may be arbitrarily testing how well you can take a multiple choice test or how well you can take a test within a certain timeframe, or how well you can write, whether or not that’s actually the topic. So if I’m learning about history, there’s some learning objectives I’m trying to meet related to history that may or may not include writing. And if writing is not one of those outcomes that we’re hoping for, then we don’t need to be assessing it.

Judie: Exactly. He did this thing on medical advancements in World War One, it was just tremendous and he was so charming, because he just was so wrapped up in it that you just had to root for the guy. It was good.

Rebecca: I love that. So for those of us who may want to move towards equitable grading systems, what are some initial steps we might take? Because it could feel really daunting if you haven’t ventured down this path before.

Meghanne: Yeah, if you are not interested in overhauling your entire grading system, just to try this out, a nd to make your assessments more socially just, there are some adjustments that can be made to existing assignments. And really, the important thing is to consider the learning objectives and really think about what needs to be graded. So one of the things that we’ve talked about a lot in all of our different presentations that we’ve done is whether or not to grade for things like grammar and spelling, and mechanics, and English language proficiency. So in an example, like a discussion board, when you’re really interested in what the students have to say, and their interaction with each other, and the questions that they asked, does it really matter if their grammar and spelling is perfect in that instance, if they’re having a great conversation on a topic, and they’re learning from each other. So that’s one thing that we could suggest. Another is thinking about just the fact that sometimes students have challenges in their lives. They’re human beings, they have families, they have jobs, many of our students are athletes, and they have to travel and they have games and something like flexible due dates is very, very helpful for students because then they’re able to complete their work, certainly within a reasonable timeframe. But if those dates are a little bit more flexible, and they have access to those assignments in the learning management system beyond the actual due date, for instance, then that gives them the ability to complete that work without being penalized. So another mechanism would be in the learning management system, when students are taking quizzes, would be allowing backtracking, allowing students to go back and check their answers, that sometimes is a setting that a lot of professors really rely on, to try to avoid cheating. And as an LMS administrator, that is something that I see a lot. And I think that that can really be harmful to students, because many of our students are told to always go back and check your work. And if they’re not allowed to go back and check their work, that can be very frustrating. And also forcing completion is something that I would recommend turning off because again, that can create test anxiety. And often I think when completion is forced, there’s also a timer. So I think if any timers can be removed as well, then that does a couple of things. It can help remove testing anxiety. But then also, if there are students who require extra time due to a disability accommodation, then the professor at that point doesn’t have to go in and adjust all of the LMS settings for those students, because it’s already open ended and everyone can have as much time as they need to complete that assessment. So it really is just important to look at what the learning objectives are and what actually needs to be assessed. And the goal is always to remove barriers. So another thing that can be done is to just ask students, have a conversation about it, and find out what barriers they’ve experienced.

John: At the start of this. You mentioned the website that you were creating, could you talk a little bit more about what resources are there and how that might evolve over time?

Katelyn: Yeah, so the website, we have been slowly adding resources to over the past two years. And at this point, it’s becoming a pretty robust little outlet for people interested in social justice assessment. So, you go to the website, you can find an overview of the big picture theory of social justice assessment, as well as the various approaches that we’ve discussed today. We also have a really pretty large bibliography of resources for further reading for people who want to learn more about any one of these topics. And we’ve been working to develop a collection of sample assignments from faculty across SUNY. So we’re still working to collect additional sample assignments from faculty who might already be implementing some of these strategies within their classrooms. I think the more we can share those assignments with one another, the better off we’ll all be. I think a lot of us are doing social justice assessment in small ways in our classroom without realizing it. So the more we can share those resources and that knowledge, the more hopefully we can get people on board. So, hopefully, we’ll be able to share that link in the show notes. And people will be able to check that out.

Rebecca: So we always wrap up by asking: “What’s next?”

Judie: So for our little group, one thing that I think might be next for us is SUNY is updating the SUNY general education requirements that are mandated with the completion of any SUNY degree. And they’ve added a requirement for equity, inclusion, and diversity. So I’m hoping that our group can help contribute resources to that effort, and our website could be one more place where people go to for information on social justice assessment so that they can incorporate those into their courses that are designed to meet the DEI requirement.

Katelyn: Well, I’m gonna go take my one-year old to the pool. [LAUGHTER]

Judie: Nice.

Katelyn: I think, big picture, though, the “what’s next” I want to just give is, I hope that we’ll start to see more institutional support for some of these approaches. I think that there are still a lot of barriers, particularly for contingent faculty who want to embrace some of these practices. So I hope what’s next will be more departmental institutional support for this: more time, more resources, etc. But yeah, my personal what’s next is I’m gonna go enjoy this beautiful day.

Rebecca: Meghanne, do you want to add anything?

Meghanne: Sure yeah, at my institution, I am sharing this information, pretty much any chance I get, I’m meeting with our new incoming faculty in a couple of weeks. And this will be one of the topics that we discuss. And I’m also co-chair of our universal design for learning task force. And we have a few events and projects that we’re working on to spread the word on UDL, and also innovative assessments and social justice assessments as well.

Rebecca: Lots of great things coming and some really wonderful resources that you’ve shared today. Thank you so much for joining us.

Katelyn: Thank you.

Judie: Thank you for having us.

Meghanne: Yeah, thank you.

John: And thank you for all the great work you’ve done on this over the last couple of years and the resources you’re sharing.

Judie: I would just like to say that Shena Salvato is also in our group. She’s at Cortland, I believe. And Chris Price from SUNY is in our group, and they are missed today. They’ve been with us for all our other presentations. I know that Shana in particular wants to get the band back together and have some more meetings going forward so we can keep working together. And it was really good to see you guys again.

Katelyn: Likewise.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]

257. PsycLearn

Adaptive learning platforms provide each student with a customized learning path based on the student’s individual learning needs. In this episode, Anna Yocom, Linda Goldberg, and Alan Strathman join us to discuss how the American Psychological Association has developed adaptive learning packages for core psychology courses.

Show Notes

Transcript

John: Adaptive learning platforms provide each student with a customized learning path based on the student’s individual learning needs. In this episode, we examine how one professional association has developed adaptive learning packages for core courses in their discipline.

[MUSIC]

John: Thanks for joining us for Tea for Teaching, an informal discussion of innovative and effective practices in teaching and learning.

Rebecca: This podcast series is hosted by John Kane, an economist…

John: …and Rebecca Mushtare, a graphic designer…

Rebecca: …and features guests doing important research and advocacy work to make higher education more inclusive and supportive of all learners.

[MUSIC]

John: Our guests today are all involved with a psych learning project, which we’ll be talking about throughout the podcast. Let’s have each guest introduce themselves.

Anna: Hi, I am Anna Yocom. I am a senior lecturer at The Ohio State University in psychology and I am also a Content Manager for PsycLearn.

Linda: And I’m Linda Goldberg. And my role with the PsycLearn project is that of product evangelist.

Alan: Hi, this is Alan Strathman. I’m a content manager for PsycLearn and was a professor of psychology for a long time at the University of Missouri.

John: Welcome, everyone. We’re really happy to talk to you about PsycLearn. I first heard about this when I was working on a project at SUNY dealing with adaptive learning solutions. And we had seen some write ups of PsycLearn so we want to find out a little bit more.

Rebecca: Today’s teas are:… Alan, are you drinking tea?

Alan: I’m drinking coffee.

Rebecca: Oh, a coffee drinker.

Alan: Sorry.

Rebecca: I see how it is. [LAUGHTER]

Alan: I had tea this morning this morning.

Rebecca: Oh, that’s good. That’s good.

Rebecca:: How about you, Linda?

Linda: I’m having an iced tea this afternoon. It’s hot and muggy outside, so something citrusy and decaf.

Rebecca: …and perfectly refreshing. [LAUGHTER]

Linda: That’s right. And sweetened.

Rebecca: Awesome. Anna?

Anna: I had tea earlier, but I have switched to water.

John: And I’m drinking spring cherry green tea.

Rebecca: Nice. I have some Scottish breakfast. Still in my pot today.

John: We’ve invited all of you here today to discuss the PsycLearn adaptive learning platform developed by the American Psychological Association. Could you tell us a little bit about the origin of this project?

Linda: Okay, I’m going to start with that. And there are a couple of overlapping facets to the origin story, so to speak. One is really a desire to expand APA’s publishing program. APA has a very rich publishing program, which includes publishing of over 90 academic journals, a very robust books publishing program, where many of those books are aimed at clinical practice, as well as books that might support the professional researcher, books that might support self help, and so on. And we found that there was an opening for us to make a contribution to undergraduate academic instruction and contribute to that portion of the path toward the profession. We also were recognizing as we contemplated this new project that there was a tremendous amount of disruption in the higher educational publishing landscape, a lot of cost pushback, a lot of desire among publishers to leverage technology. And we thought that perhaps not simply for delivery of content, but to improve the learning experience and to improve efficacy that we saw there might be some opportunity there.

Alan: Yeah, also, let me jump in. I think the developers also saw this as an opportunity to work toward some of the goals that APA has for the field of psychology, including, for example, utilizing psychology to make an impact on social issues.

Linda: And the field of cognitive psychology is one that tells us a lot about how we learn. So we felt like we could draw from our very own field in development of our final product,

John: Which courses have been developed for this platform.

Linda: So we started with a course for research methods and psychology and added a PsycLearn statistics for the behavioral sciences to that. These two courses are typically required for all majors in the discipline. And they also represent the most challenging content for many students. So we thought that seemed like a good place to start.

Rebecca: Can you talk a little bit about how this material was developed?

Alan: Sure, we use a backwards design process where we start by identifying what we want students to learn in each module and a module is similar to what would be a chapter in a regular textbook. These outcomes that we have in mind become Learning Objectives, and they really guide the content development. Learning Objectives are developed through collaboration, a conversation, maybe a hashing out between the subject matter experts and the content managers, and are influenced by a variety of factors, including how well the learning objectives address APAs guidelines for undergraduate education. And then there is a rigorous review process where other experts in the field provide feedback and often suggest additional learning objectives

John: Was there much of a challenge getting agreement on learning objectives. I know in many disciplines, there’s a lot of discussion of what should be in the core material in the discipline? Has psychology been able to overcome that a bit by agreeing on these standards?

Alan: Well, I think it is a challenge in every case, because everybody has a sense of what they think should be taught and what is essential for students to learn. Like I said, I think it’s hashing out. It’s sometimes a little bit of trial and error, where we identify a learning objective, and then start writing about it. And then at some point, we may decide that’s not the right objective to have. But I think in the end, the subject matter experts and the content managers do a really good job of coming to some consensus on what we want to teach.

John: Was the content in the courses, the actual readings and other materials, developed by the people who created the package?

Alan: Absolutely. We are a digital first product, with original content developed by experts in various sub disciplines in psychology. And this really gives us a big advantage I think over print textbooks. So starting from scratch, in an entirely digital environment, we can develop a seamless presentation, where we start with learning objectives, we present content, we design activities and interactive exercises, and then have assessments. And we can be sure that all those things are aligned with learning objectives. And we don’t have to try and retrofit learning objectives into existing content. And then just hope that assessments that we have address the new learning objectives. So I think being able to work in a digital environment allows us to have this really seamless presentation where we start with learning objectives and we go all the way through assessment, and all those things match.

Rebecca: You’ve hinted a little bit about maintaining the content, given that it’s in a digital platform. But can you talk a little bit more about how you maintain that or what that review processes is or how that gets updated on a regular basis?

Alan: Well, that’s a good question. One issue for us is that we’re still so new, that we haven’t had semesters and semesters of feedback from students that we can use to make revisions. But what is really exciting is that whenever we decide that we want to make a change, we can do it in real time. Think about a print textbook, whenever they decide that they want something to be different, they might wait three to five years for the opportunity to make those changes. With us, since it’s digital first, we decide something needs to be changed or updated or revised and we can make those changes in a really timely fashion. And I think it really helps to keep our content current.

John: And if you find that students are not achieving the learning objectives, you have the ability, at least, to make some changes, either redefining the objectives if perhaps the objectives didn’t work too well. Or if the learning materials weren’t quite aligning with that. How often is that type of change done?

Alan: Well, so far, we’re still into the development process, that we’re making those changes just all the time. As the products get older and more mature, I think we’ll need to do that less. But again, we’ll still have the opportunity to do it as often as we’d like to.

Rebecca: John mentioned at the beginning of the episode about his interest in this project related to adaptive learning. Can you talk a little bit about the adaptive learning component of this project and the platform that you use.

Anna: The platform that we use is CogBooks, it is a platform, I think, is really unique compared to other textbooks, because it allows students to engage in their learning, and really direct their own learning pathway. And that’s based on their understanding of the content. So instead of going through a whole chapter, and then maybe quizzing yourself or testing yourself, after each content page, they get some formative questions and they get to make their own assessment. They get to say, “Okay, did I understand that? Was I not too sure? How did I do on those questions?” And then they can choose whether they want to get that support material or not, which we think of as like, “Would you follow up and ask your instructor a question.” That’s how we think of this support material. So if a student is very confident with the material, they’re essentially going to get a different path than a student who might need help in a couple of different areas or a student who might need help in a lot of areas. There’s just more examples or more practice. So it can look a little bit different for each student, which is pretty cool.

John: Linda mentioned earlier that psychologists have done a lot of research and cognitive scientists have done a lot of research on how people learn, how have some of those principles of how we learn been built into this platform?

Alan: Well, Linda is certainly right. There is a lot of research on learning science. And because we are psychologists, we’re familiar with the research, and use that knowledge to help students learn throughout the product. I think the centerpiece of our efforts to use learning science is the inclusion of metacognition, that is helping students evaluate their own learning, helping them identify what they know and what they don’t know. And when they identify what they don’t know, then they could spend a little more time learning that particular topic. Often students get to the exam, and they haven’t really done a good job of testing themselves, identifying what they know, and what they don’t know. And the first time they realize they don’t know something is when they get to the exam. And that’s obviously not the right time to get there. And so we’re able to identify ways that we can help them evaluate their own learning. We help them in this process by incorporating those learning strategies that we know are supported by research. We present concrete examples throughout. We have frequent activities and assessments. Students get practice retrieving content from memory. And these opportunities are spaced just as the research suggests they should be. They have interactive exercises. They get practice in the elaboration, or explaining content to themselves in their own words. And really the process of taking material and from the jargon in which it’s presented to explaining things in their own words, is a really useful process for students to engage in. And we could have a whole podcast just on principles of learning science that PsycLearn incorporates.

Rebecca: Can you talk a little bit about what the student experience is like for students that are using the platform? So Anna, you hinted a little bit at this with some of the adaptive learning components. But what does it look like from: I entered this space from the beginning, and now I’m interacting with this over time.

Anna: So students really, I think, approach PsycLearn differently than a printed textbook, again, not only just the fact that they would go through a printed textbook, and then maybe ask themselves some questions, probably skip over a lot of reading, because maybe it’s not very engaging or easy to get distracted with print textbooks as well. But one of the really interesting things is that they’re engaged with the content pages within them. So they’re not just engaged outside of content, like “Oh, refer to this video,” or “you can reference this activity” or “try some completely different platform to help with your reading….” but within the content pages, they get activities in which they’re asked to reflect on the course material. How does this connect to things you already know? So they get to respond to those things within the content pages. They get practice formative questions, formative meaning that it’s not just did I get this right? Yes or no. But they get feedback. So they would find out what a suggested answer was to a short answer question. They can compare that to their own. With a multiple choice question, they get follow up on why that is the correct answer, not just “Well, if I’ve missed this a couple of times, and they get multiple chances to respond, but they get some explanation about why that was the correct answer.” And so we have video questions, we have matching exercises, we have short answer, we have multiple choice questions, different drag and drop. So we’ve tried to just vary the kinds of interactions that students would have, the ways that they can practice answering questions. And this variety really helps maintain interest throughout. So they get to engage it in lots of different ways. It’s not just a rote memorization, but they’re actually applying the material as they go through each module.

John: So you mentioned formative questions. Are there are some assessment tools built in to evaluate students’ learning for grading purposes, for example?

Anna: There are. Yeah, so there are summative questions. And we try to have them associated with those learning objectives that Alan had talked about earlier. And so after maybe one, two, or a small group of those learning objectives are covered, there is a short sample, maybe 5…10 multiple choice questions where students have a few attempts, and we want them to get to about an 80% accuracy. And one of the nice things is if they don’t on their first attempt, they can actually go access those support pages then. So maybe they skipped over them earlier. And they thought, “Okay, I got this, it’s fine. I understood this page.” And then they get to these questions later on, these mastering the content and they’re like, “Well, wait a minute, I was missing some of this.” So they get another chance to go back to those support questions, and try it again. So then hopefully, they can get those right after three attempts. We don’t want them to be punitive. We want them to get engaged with the material and get to that mastery.

Rebecca: So now that you’ve talked a little bit about the student experience, can you talk a little bit about how this supports instructors? What kind of feedback is provided to instructors and maybe how instructors are using this in their teaching.

Anna: One of the things I really like, we all know, anytime that we can even maybe think back to our own experiences in classrooms, it’s a struggle getting students to read. But a lot of these classes, I mean, really all of our classes, if we’re assigning some sort of book, some reading material, we want them to read it. So how do we get them to engage? Well, that’s where the accountability comes in. So we’re giving them this tool, and then their instructor can see, “Okay, they’ve made it through this material, they engage with this.” So the instructor could choose to then reiterate that material in class, or they could choose to maybe take an active learning approach in class. And okay, now that you’ve had this background, everybody made it through, we’re going to apply it. And maybe not everybody got to 100% on every question, but maybe we got to about over 90% completion, which is what I would typically see in my classes. So you would have students who, even after a few attempts, would sometimes miss some of those mastering questions, but generally, it was pretty high. And so I could see that before I went into class. Okay, so students, as a whole, on average have got this. So I can take it a step further, where I can go back to those questions that were really challenging. So you get to track progress through each module, you can also dive a little deeper with individual students. So a student comes to you and says, “I’m really struggling,” the instructor can go in there, they can look at their pathway. Were they accessing the support material? Did they take those quizzes a few times? Where were they spending their time? Or if the instructor wanted them to cover it on let’s say, Tuesday night, were they doing it all Tuesday at 9pm? Right? Like you could actually see all of that. So you can kind of work with them like, “Well, I see you started this that night, let’s think about how we could maybe back that up. Like maybe we should pace this out at least a few days ahead of time, which is a really nice way to work with students.” And it also syncs with the LMS, the learning management system, so it really takes that burden off of instructors as well. So it’s talking to the platform that we get there. So we get this easy back and forth, which is really nice. So we can nudge students along with that, I would often encourage students to visit those support pages if they were struggling, like, “Look, I know this is really challenging,” or, “Hey, there’s more practice, if you just want a little bit more practice, you can go to some of those support pages to get that.” And the other nice thing is students can actually email right from there, which I think is pretty unique. So if a student emails me, I could see okay, they were having problems in statistics with variability and standard deviation. And it will take me as the instructor right to that page. And so then I can see that and I can say, “Oh, well, why don’t you try these examples here,” which was really nice. Instead of just a student saying, “I don’t know, I don’t get this,” they can let you know exactly where they’re struggling. So it provides a lot of options for instructors.

John: And do instructors get aggregate statistics on what areas students are struggling in addition to data on individual students?

Anna: Absolutely. So you can see that on the dashboard. You can see if there were chunks of mastering questions, for example, or a specific question that students struggled with. So you could choose to review that and maybe even go over some of those in class or go over specific topics in more detail.

John: How are instructors combining this with other face-to-face learning activities, for example, in face-to-face classes. As I understand it, most people use this as a textbook replacement, except a much more powerful replacement to a textbook. What other things will people often do to provide more of a sense of community or a social component to the learning?

Anna: Yeah, so, I think a lot of instructors are using it, just as you said, as a textbook replacement. And that’s how I have used it for statistics in particular. So it was taking the place of my other textbook, which actually was a print textbook that was online. And so I don’t feel like there were any losses. But we were gaining the ability to say, “Okay, we’re all on the same page. I know that everybody’s at least had some exposure to this. So now let’s talk about it. I can see where you were struggling. So I know we’re going to need more examples here. I know we’re going to need more follow up here.” Or “why was this question challenging? Why was this hard?” So I think drawing on those parts are how we can maintain those social ties and the social interactions we want whether it’s online, whether it’s face to face, or in any capacity.

Linda: I’ll just go ahead and point out as well that part of the content package that we’re making available to instructors who adopt, PsycLearn course material is a set of student activities that sort of exist outside of the platform itself and are available for instructors to assign or to bring to the class. They’re typically designed again to align with specific learning objectives and to give the instructor options for an in- class activity or an additional assignment activity. And that’s accessible to the instructor when they’re using the dashboard.

Rebecca: Sounds like some really great support materials. Can you talk a little bit about how this platform has affected equity gaps that we might be seeing?

Alan: Sure, I think there are two ways that PsycLearn is addressing issues of equity. First, we are designing PsycLearn to be culturally inclusive, that is we work to make sure that through examples, images, photos, figures, every student can see themselves in the product. Plus, our goal is to include the research of diverse psychologists and psychologists of color. And then I think the second way that we strive to be equitable is to design for universal access. We want the product to be accessible to all students, and so we make great efforts to do so. We use typography that’s particularly accessible. We incorporate transcripts and closed captioning, we have text-based alternatives for non text elements. And our efforts are well beyond what the minimum guidelines would be, well beyond what typical expectations would be, and I want to say that this is because we value this process so highly. We are keenly interested in making an accessible, inclusive product, and I think we’re really working hard to do that.

John: Have there been any studies of the overall efficacy of this program compared to alternatives?

Linda: Well, we have conducted some impact surveys, surveys of student users to gauge their impressions of the impact of PsycLearn on certain important aspects of their experience. Through surveying students, we looked at the impact on their knowledge gains, on their confidence in their ability to use that knowledge, and on motivation to complete assigned activities. And on the questions that we asked, to sort of tease out each of these thematic areas, we did receive very positive response. Now, these are, albeit, impressions of students. That’s sort of the first line of study available to us. And we feel pretty motivated ourselves by what we’re learning, by what we’re hearing from students. These surveys did also include some open text entry questions. And very interestingly, some of the criticisms that we heard were often this is a lot of time, this is a lot of work. But by the same token, we’ll hear in the very same response, but it’s very worth my time, and it really helps. And I feel confident when I go into the class, and I already know what my instructor is going to talk about, I feel more relaxed, I feel more able to pay attention. That kind of response has been very rewarding to receive from these student surveys.

John: With some other platforms, there have been studies that have looked at the impact on equity gaps, and they relate very much to what you just said, that basically, students come into our classes with very different backgrounds. Some come in with a very rich and strong background from prior courses, others come in with a somewhat weaker background. But to make it through an adaptive learning platform, the students who come in with less background can acquire mastery, but it takes a bit more time and effort. And the students who come in with a stronger background can race through a little bit more quickly. But much of the research does suggest that those equity gaps tend to be reduced. But it is at the cost of additional effort by those students who come in with a little bit less prior knowledge or prior experience with some of the material. And so I think that’s one of those real strengths of adaptive learning platforms compared to other formats like textbooks and lectures and so forth, where everyone is expected to move at the same pace. But as Chuck Dziuban, on a previous podcast has said, in a traditional course, everyone spends the same amount of time with the material, but they learn different amounts, when they’re working with adaptive learning platforms, they have to spend different amounts of time, but they all can achieve the same learning outcomes, they can all reach the same outcomes. But it may take more time to do so.

Linda: That’s certainly our hope, and some of what motivates the work that we’re doing. I feel like having respect for the time that our students need to spend is top of mind. We need to make sure that what we’re asking them to do is a good use of their time. And therefore this mode of delivery and the kind of content that we make available through the multiple activities and so on that Anna was describing. We’re giving our students opportunities to do that self testing that reiterative process and not simply trying to digest a narrative.

Anna: I always think back to a student I actually had in class a number of years ago, and this student went through the same class multiple times. And it was a class that was needed to get to other upper-level classes and was very frustrated, of course. And then we came to find out that this student in the multiple times of taking the class, the book was listed as required, but with either a digital or print textbook, you really don’t have any way to monitor that. You don’t know if the student’s using the book even if they have it. But this student had never got the book, just never occurred to them that, okay, this could be a really valuable tool. And so that’s really a benefit. I see. Like you were talking about equity, let’s give them this tool. But let’s make it something that’s valuable, that can really help them and if they need that added support, they’ll get it. But kind of level the playing field a little bit.

Rebecca: How do you see this platform evolving over time.

Linda: So we are able to work fairly closely with our platform partner, CogBooks. We’re able to contribute to their roadmap planning to some degree. We’ve collected feedback through a variety of channels, also, not only the student surveys that I’ve mentioned, but we also, in the past year, conducted a qualitative study that included student interviews and observations of students who were assigned to use PsycLearn. And this exercise gave us really valuable insight into how and where students focus their time and attention. And so for instance, through that process, we were able to get some real good insight into how they approach the summary of each module. And as a result, we’ll be able to give some greater attention, we’ve got some plans to enrich and make more accessible, the content that we placed there, because we were able to learn that they highly value that for later test preparation. So that’s just an example. We’re hoping to be able to continue to do those observational and interview studies.

Rebecca: So I’m really curious for each of you to answer this question. But what makes you really excited about PsycLearn?

Anna: I’m happy to go first, because I am a very energetic instructor. I will be at the front of the room, and I bring a lot of energy. And what makes me excited about PsycLearn is just the ability of students to be active consumers of their learning. I would love for them to take away something that is memorable, that feels unique. And so PsycLearn frees me up as an instructor, that I don’t have to go through every bit of background information in the way I use it in class, I can assume they’ve had things. Let’s spend time on things that are interesting. Let’s dive deeper into things. Let’s do more exercises for things that are challenging. And so the students get to think about and apply new ways of learning and engaging the material from the very first moment that they encounter the content.

Alan: Yeah, for me, it’s really about the inclusion of metacognition, I think it’s really helpful to have students be able to evaluate their own learning. I think this makes them do better on exams, and I think it makes them more successful in their entire college career. It’s also an important part of my own teaching. I have a lot of activities in class where students can answer and identify how well they know what they’re supposed to know. And what I often find is that students study, but they don’t know how much to study, they don’t know: “Do I know it as well as I need to know it.” And this product gives them a lot of feedback, really helps them understand if they understand the material as well as they need to. And PsycLearn really can do that in ways that regular textbooks cannot.

Linda: I would say that my excitement really comes from the big picture, the opportunity for us to deliver on these experiences that Anna and Alan are describing. But we’re going to be able to do that across the foundational courses in the curriculum. And so that larger picture future horizon is pretty exciting.

John: Well, you’ve already addressed some of this, at least in terms of PsycLearn, but we always end with the question: “What’s next?”

Linda: Well, we have sort of talked a little bit about future and what’s next and our opportunity to be iterative. The digital platform allows us to be continually rethinking what is the best activity to offer to reinforce or bolster certain concepts. And so that’s certainly something that is ongoing. We can take feedback from students on how well they feel various content is supporting them. We’ll be looking at what we can do to encourage a greater level and engagement with that support material, so that students aren’t feeling like, “Oh, that’s extra, I don’t really need to go there.” Indeed, it’s extra. But it’s really vital, especially for students who might sort of marginally understand. And so the opportunity for us to deliver a reframe of a concept can make all the difference at that tipping point.

Anna: Yeah, and I think what Linda had said about using the support material is really important to us. So we’re really interested in applying these learning science principles that Alan had talked about to say, “Okay, what is the best way to get students to engage with this.” We want them to see that cool stuff we’re putting on those pages, if they feel like they could benefit of it. So we want to reach the students that need that support. So I think just diving in a little deeper and figuring out the best ways to reach them, to get them to say, “Okay, yeah, I could use a little practice.” Or “I could use another example,” snd really assess that learning of their own. It’s a challenge. It’s a challenge we have constantly, especially when students are new at something, they tend to think, “Oh, yeah, I got this. I know it all.” And so getting better at that metacognition, I think, is really exciting to us.

Alan: Yeah, and I think for us, it has a lot to do with making a better and better product. I think about what it was like the first time I taught a course. And I equate that to the first iteration of a PsycLearn product. And then I think about what was it like the fifth time I taught that course or the 10th time I taught it, and how richer and deeper it was. And I think the same thing will happen with PsycLearn. We’re going to keep on creating a product that gets richer, more inclusive, and more likely to help students succeed.

John: I was really excited to hear about PsycLearn, and everything you’ve talked about makes me even more excited about the opportunity for this and I hope that other disciplines will start working on similar materials for their basic courses, because the benefits from this have been well established in terms of improving student learning and reducing some of the equity gaps. Thank you.

Linda: Thank you.

Alan: Thank you.

Anna: Thank you.

[MUSIC]

John: If you’ve enjoyed this podcast, please subscribe and leave a review on iTunes or your favorite podcast service. To continue the conversation, join us on our Tea for Teaching Facebook page.

Rebecca: You can find show notes, transcripts and other materials on teaforteaching.com. Music by Michael Gary Brewer.

[MUSIC]