Scattershot Rollout of The Nextgen Bar Exam May Exacerbate Disparate Bar Pass Outcomes Along Socioeconomic and Racial Lines
Law school graduates will not be sufficiently prepared for the new bar exam scheduled to be administered in 2026. Twenty jurisdictions have already adopted the NextGen bar exam and six of the 20 have committed to administering the exam in 2026 even though crucial information about costs, scoring, portability, and the substantive content is not yet available.[1] Only fractional information has been released about the exam, and there have been far too many substantial changes to that already fragmented information to allow academic support faculty and commercial bar review providers to effectively prepare current law students who will be in the first wave of NextGen examinees.
Amy Meyers, Director of Academic Skills & Bar Success at Willamette University College of Law, reached out to the Association of Academic Support Educators desperately seeking help to fill in the many information gaps about the NextGen exam. In an email to the Association’s president, Meyers pleaded:
“My knowledge is based solely on the NCBE press releases and what I can gather from the [academic support listserv]. As a lawyer, I don’t like relying on hearsay. As an educator, I don’t like trying to teach based on the breadcrumbs I can piece together from those sources. It seems to me that my students should be preparing for such a high-stakes test as the NextGen Bar Exam with more clarity than I can provide. That’s not a comfortable feeling.”
The proprietor of the NextGen exam, the National Conference of Bar Examiners (“NCBE”), has published only piecemeal information distributed over sporadic intervals about the exam’s substantive content and format. Recent statements by the NCBE have contradicted the entity’s earlier promises about the scaled-down exam. The incomplete and inconsistent messaging from the NCBE could potentially impede the performance of bar takers and further contribute to disparate bar passage rates along socio-economic and racial lines. This scattershot approach to communicating essential information leaves law school academic support faculty without the clear, consistent, and reliable guidance necessary to prepare graduates for the new bar exam. With the added emphasis on bar passage in accreditation standards and law school rankings, legal educators cannot afford to silently acquiesce to the significant uncertainties presented by this rollout of an exam that will determine the future careers of law school graduates and the standing of law schools.
After careful scrutiny of all released information, we find the small set of sample questions covering only limited subject matter, coupled with the unclear description of the most recent changes to the not-yet-released exam, wholly insufficient to offer fair and reasonable notice as to the format, content, scoring, scaling, and resources available for the licensure exam. Our specific concerns are summarized below:
Contradictory Information Regarding Exam Scope and Content
- On May 25, 2023, the NCBE announced the eight subject areas to be tested on the NextGen exam: Business Associations; Civil Procedure; Constitutional Law; Contracts; Criminal Law and Criminal Procedure; Evidence; Real Property, and Torts.
- The NCBE stated, that the new exam will no longer require examinees to have a base of knowledge in the areas of conflict of laws, family law, trusts, and estates, or secured transactions, but these topics may still be included in certain legal scenarios for which examinees are provided relevant reference materials . . . .[2]
- However, on May 29, 2024, the NCBE contradictorily announced that from July 2026 through February 2028, family law and trusts and estates will appear on every NextGen exam in a performance task and may also be included in integrated question sets.[3]
In addition to the late release of the significant additions of two areas of black letter law, we are deeply concerned that the NCBE has not provided a content scope outline for Trusts or Estates. The test maker has stated that these content outlines will be published by “late 2024,” but that illusive commitment still leaves law schools with less than three full semesters to make the necessary adjustments to curricular content.
The information currently provided by the NCBE is too vague to allow prospective NextGen examinees to thoroughly prepare for the exam. Due to these uncertainties, we urge the NCBE to limit the subject matter of the exam to exclude Family Law, Trusts, and Estates. Bar applicants taking an exam in 2026 should have the benefit of knowing the scope of exam content when they entered law school. To do otherwise will place early NextGen applicants at a comparative disadvantage to applicants who will be taking the UBE in 2026 and 2027.
Insufficient Pilot Testing
The NCBE conducted pilot testing for the NextGen exam from August 2022 to April 2023, but only limited and self-reported information is published about the outcomes of the pilot testing.[4]
Because the pilot testing took place before the decision to expand the scope of the NextGen exam to include Family Law, Trusts, and Estates, we are concerned about the reliability of the pilot test as a predictor for the timing and/or performance on the NextGen exam. We urge the NCBE to conduct additional pilot testing to assure all stakeholders that there will be stability between scores for the current Uniform Bar Exam and the NextGen bar exam.
Legal Reference Materials are Essential to Assess Law Practice Skills
- On June 3, 2024, the NCBE announced that it will not provide legal reference material on the NextGen exam; but that it would provide relevant, targeted resources for some question types, and questions on certain topics within the foundational concepts and principles.
- Nestled in the release of the pilot testing results, is the NCBE’s decision to exclude additional legal resources from the NextGen exam.
According to the NCBE, the aim of NextGen exam is to make the bar exam more realistic and to reduce the amount of legal knowledge that candidates must commit to memory for the exam, while emphasizing law practice skills. Lawyers in practice do not rely on memorization, but on skilled access to legal and information resources. Yet, despite the reality of law practice and its own claimed intention, the NCBE appears to have done an about-face on providing the Federal Rules of Evidence as reference material on the exam.[5] This significant departure does not support the assessment of practice-ready lawyers.
We are reasonably reluctant to rely on the NCBE’s promises of forthcoming materials and the provision of resources during testing because of the many previous changes and the recalcitrant decision to exclude promised reference material that a majority of pilot test takers relied upon. More in-depth research should be conducted by independent psychometricians unaffiliated with NCBE to assess how access to reference materials might impact performance indicators that are not captured in exam scoring like test anxiety and imposter syndrome.
The NCBE Has Offered No Guidance for the Testing of Legal Research
- The NCBE’s website says that it is still “exploring options for testing legal research” and that sample questions testing legal research will be available at a later date that remains uncertain.
The overwhelming majority of current law students who will be taking a bar exam in 2026 and 2027 have or will have completed the required courses in Legal Research and Writing prior to sample questions being released. The unfairness of the promised late release will be compounded on individuals who lack the time and money resources to engage in costly bar preparation programs. Those individuals are more likely to benefit from law school academic support programs, and yet the academic support faculty have not been able to offer any meaningful guidance that will make their bar exam success more likely. We urge the NCBE to delay testing of legal research until 2028 or some future date when law students can have fair notice and access to the scope and content of exam questions in this areas to be tested.
Academic support faculty cannot appropriately aid in the bar readiness of our students and future graduates with vague, incomplete, and constantly changing information from the test maker. We implore the NCBE for its cooperation and recognition of the potential to exacerbate alarming disparities in test outcomes for law school graduates who have the greatest need for academic support programs.
ON BEHALF OF THE ASSOCIATION OF ACADEMIC SUPPORT EDUCATORS[6]
[1] https://www.ncbex.org/exams/nextgen
[2] https://www.ncbex.org/news-resources/ncbe-publishes-content-scope-nextgen-bar-exam
[3] See https://www.ncbex.org/news-resources/illinois-administer-nextgen-bar-exam-2028 (During this period, family law concepts will be tested with the provision of legal resources. Starting in July 2028, family law and trusts and estates will be included in the foundational concepts and principles tested on the NextGen bar exam and will be tested in the same manner as the other foundational concepts and principles.)
[4] https://nextgenbarexam.ncbex.org/reports/research-brief-pilot-testing/#whatis1
[5] https://thebarexaminer.ncbex.org/article/winter-2022-2023/the-next-generation-winter-22/ (“Another major change underway for the new exam is the plan to provide examinees with supplemental materials where appropriate, such as relevant portions of the Federal Rules of Evidence, so that they need to rely less on specific recall of legal doctrine details.”)
[6] The Association of Academic Support Educators is a non-profit professional organization for law school academic support educators. Our members collaborate to develop research-based teaching methods and enhancement programs that empower students to succeed in law school, on the bar exam, and in the practice of law.