Thursday, November 12, 2020
Brief Intervention Statistically Improves Bar Exam Outcomes
In general, I don't believe in show and tell lectures. In particularly, I'm not convinced that a few powerpoint presentations about the benefits of mindfulness or positive growth mindsets can make much of a difference in academic performance. But, I do believe in the power of show, tell, and do experiences in changing lives for the better. And, there's research out of California funded in part by AccessLex to support my supposition.
As previously detailed, a brief intervention focused on belonging can make a big impact on undergraduate academic performance, especially for underrepresented minorities. Be-Long-Ing! It's Critical to Success (Oct. 3, 2019). Now, researchers in partnership with the State Bar of California and funding from AccessLex have expanded that work to the field of bar licensure. https://mindsetsinlegaleducation.com/bar-exam/
The brief 45-minute online program was made available to all bar takers for both the July 2018 and July 2019 California bar exams. Id. Interested bar applicants were able to freely sign-up for the program, which was timed to coincide right before bar preparation studies began. "The program include[d] an introductory film, stories from prior test takers, and a writing activity in which participants share[d] insights and strategies that m[ight] be useful to them and to future test takers." Id. In their research, the authors controlled for traditional bar performance predicators (LSAT and LGPA) along with psychological factors, demographic factors, and situational factors to evaluate whether the brief 45-minute intervention yielded statistically beneficial improvements in bar exam outcomes. Id.
According to a summary of the findings, "[t]hose who completed the full program and thereby received the full treatment saw their likelihood of passing the bar exam rise by 6.8-9.6%. Among all people who passed the bar after completing the program and thereby receiving the full treatment, one in six would have failed the bar if they had not participated in the program (emphasis in original)." Id. Significantly, as stated more completely in an article by the researchers, "[t}he program particularly helped applicants who were first-gen college students and underrepresented minorities, according to our analyses." Quintanilla. V., et al., Evaluating Productive Mindset Interventions that Promote Excellence on California’s Bar Exam (Jun. 25, 2020).
In finding evidence in support of the program, the authors posited a possible social-psychological explanation for the promising results:
"The California Bar Exam Strategies and Stories Program was designed to improve passage rates by changing how applicants think about the stress that they encounter and the mistakes that they make when studying for the exam. Our initial analyses of the effect of the program on psychological processes suggest that the program worked as intended, by reducing psychological friction. Participants appear to have succeeded in the face of stress, anxiety, and mistakes by adopting more adaptive mindsets. They moved from a stress-is-debilitating mindset to a stress-is- enhancing mindset. They learned to reappraise the anxiety they experienced. And they shifted toward meeting mistakes with a growth mindset rather than a fixed mindset." Id.
As I understand the research, the researchers provided bar takers with research about tactics to turn stressors from negatives into positives and engaged bar takers in implementing those strategies. In my opinion, a primary reason why the intervention was so promising rests with the last step of the intervention, in which bar takers took positive action to help future bar takers, by having bar takers write letters to future takers sharing their experiences in learning to transform frictions into pluses.
In short, the intervention empowered people to make a difference, not just for themselves, but also for future aspiring attorneys. That's a wonderful win-win opportunity. And, there's more great news. The researchers are looking for additional participants to expand the program to other jurisdictions. For details, please see the links in this blog. (Scott Johns).