Monday, November 19, 2012

How to Increase Your Law School's Academic Reputation

USNewsLaw schools care deeply about their academic reputation.  If this were not true, my Indiana Law mailbox would not be stuffed full with glossy brochures sharing the news of faculty publications, impressive new hires, areas of concentration, and sundry distinguished speaker series, etc. 

Because of the timing of these mailings – I got nearly 100 in Sept and October—I am guessing that the senders hoped to influence the annual U.S. News & World Report Academic Reputation survey.  Cf. Michael Sauder & Wendy Espeland, Fear of Falling: The Effects of U.S. News & World Report Rankings on U.S. Law Schools 1 (Oct 2007) (reporting "increases in marketing expenditures aimed toward raising reputation scores in the USN survey"). But does it work?  A recent study by Larry Cunningham (St. Johns Law) suggests that the effect is, at best, decimal dust.  

Glossy brochures may not reliably affect Academic Reputation, but I have uncovered four factors that are associated with statistically significant increases and decreases of USN Academic Reputation.  To illustrate, consider the scatterplot below, which plots the 1993 ordinal rank of USN Academic Reputation against the 2012 ordinal rank [click on to enlarge].

BarFour sets of dot (Red, Blue, Orange, and Green), each representing distinctive shared features of law schools, tend to be above or below the regression line.  These patterns suggest that changes in USN Academic Reputation over time are probably not the result of random chance. But we will get to the significance of the Red, Blue, Orange, and Green dots soon enough.  

The primary takeaway from the above scatterplot is that 2012 USN Academic Reputation is overwhelmingly a function of 1993 USN Academic Reputation.   Over 88% of the variation is explained by a school's starting point 20 years earlier.  Part of this lock-in effect may be lateral mobility.  That is, there are perks at higher ranked schools: they tend to pay more; the teaching loads are lighter; and the prestige is greater, etc. So school-level reputations rarely change, just the work addresses of the most productive scholars.  This is, perhaps, the most charitable way to explain the enormous stickiness of USN Academic Reputation.

That said, the scatterplot does not show a perfect correlation; slightly less than 12% of the variation is still in play to be explained by influences other than starting position.  A small handful of schools have made progress over these 20 years (these are the schools above the regression line), and a handful have fallen backwards (those below the line).

BarThe Red circles, Blue rectangles, Orange diamonds, and Green circles represent four law school-level attributes.  The Reds have been big gainers in reputation, and so have the Blues. In contrast, the Oranges have all experienced big declines; and as as a group, so have the Greens.  When the attributes of the Red, Blue, Orange, and Green Schools are factored into the regression, all four are statistically signficant (Red, p =.000; Blue, p = .001; Orange, p = .012; Green, p = .000) and the explained variation increases 4% to 92.3%.  As far as linear models goes, this is quite an impressive result. 

Before you look below the fold for answers, any guesses on what is driving the Red and Blue successes and Orange and Green setbacks?

Continue reading

November 19, 2012 in Data on legal education, Important research, Innovations in legal education, Scholarship on legal education, Structural change | Permalink | Comments (4)

Thursday, September 20, 2012

Drop in the Big Law Median Salary is only Half the Story

NALP just announced that the median salary for first year associates in Big Law has dropped from $160K to $145K.  I think that is very significant.  We are now back to to the entry level price point of 2007.

But to my mind, there is much bigger story here.  In 2011, firms of 500+ attorneys hired 2,856 entry level lawyers.  In 2007, that figure was 4,745.  So, after five years, Big Law is paying the same wage but hiring 40% fewer lawyers.  Compare 2007 NALP Nat'l Summary with 2011 NALP Nat'l Summary

Here is another important piece of NALP data, generated from the print versions of the July 2012 NALP Bulletin.  It shows the percentage of entry level law jobs that are private practice.


Two takeaways here: (1) there is a longterm trendline showing a declining number of private practice jobs--and that is the economic engine that enables law schools to exist at current tuition levels, and (2) the cliff-like dropoff in 2010 and 2011 is likely Big Law, and that hurts.

[posted by Bill Henderson]

September 20, 2012 in Current events, Data on legal education, Data on the profession, New and Noteworthy, Structural change | Permalink | Comments (5)

Monday, September 3, 2012

Location, Location, Location – Geography Matters in Law School Employment 2010-2011

NALP notes that for the Class of 2010 -- and the Class of 2011 -- two-thirds of all employed graduates were employed in the state in which their law school was located. This suggests location matters.

Is location important to employment results at a large number of schools? Are some law schools more national than others? Are some states more “local” in hiring than other states? The answers are yes and yes and yes.

ANALYZING SCHOOL SPECIFIC DATA -- This analysis is based on the Class of 2010 and Class of 2011 employment outcome data reported on the ABA Section of Legal Education website, excluding the law schools in Puerto Rico. This means there are 195 law schools in this analysis (if the two Widener campuses are combined).

The law schools were asked to report the three states with the most employed graduates and the number of employed graduates in each of those three states. Taking those totals as a percentage of employed graduates, and paying attention to the states identified, one can get some idea of which schools are “regional” and which schools might actually have a more “national” footprint. The simple result of the analysis is that the vast majority of schools are “regional” rather than “national.”


  1. For both the Download Class of 2010 and the Download Class of 2011, there were 117 law schools for which more than 67 percent of their employed graduates are employed in the state in which the law school is located.
  2. For the Classes of 2010 and 2011, there were 144 and 145 law schools, respectively, for which more than 67 percent of their employed graduates are located in the state in which the law school is located or an adjacent state, and 104 law schools for which more than 80 percent of their employed graduates are located in the state in which the law school is located or an adjacent state.
  3. There were only 46 law schools for which less than 67 percent of their employed graduates were employed in the state in which the law school is located or an adjacent state for both the Classes of 2010 and 2011.

Notably, 28 of these 46 law schools are in the USNews top-50, for which it is easily imaginable that the employment geography is much more national than regional. For many of these 46 law schools, two of the three states with the most employed graduates generally are not adjacent to the state in which the law school is located, suggesting some national reach. The three non-adjacent jurisdictions reflected most frequently should not be surprising – California, the District of Columbia and New York. Of the 18 other law schools, nine law schools are ranked in the alphabetical list of schools -- schools one generally would consider regional – while nine are ranked between 51 and 145 in USNews.


Perhaps most significantly, due to the incomplete nature of some of the data sets, this summary probably understates the number of law schools for which the employment outcome data suggests the law school is more regional than national. Several of these 46 law schools come in with 60% or more of their employed graduates employed in the state of the law school or an adjacent state for both years -- Boston College, Minnesota, NYU, Ohio State and Penn State – and if the data were to include graduates employed in all adjacent states, the total for these schools well might exceed 67 percent.

In sum, then, more than 76% of all law schools and more than 87% of law schools outside the USNews top-50 had more than 67% of their employed graduates in the state in which the law school is located or an adjacent state for either the Class of 2010 or the Class of 2011.

LOOKING AT STATE SPECIFIC DATA -- NALP also notes that for the Class of 2010, there are 30 states in which two-thirds or more of the jobs were taken by graduates from law schools in those states. (Jobs & JDs, Class of 2010, p. 69)  Taking NALP’s state-specific data for the Class of 2010 in conjunction with the ABA’s data for the Class of 2010, there actually are 35 states in which two thirds or more of the jobs were taken by graduates of law schools in those states or an adjacent state and 30 states in which three-quarters or more of the jobs within the state were taken by graduates of the law schools in the state or in an adjacent state.


Again, this data likely understates the results. For example, in Arizona, Colorado, Connecticut, Maryland, Tennessee, and Virginia, roughly 65-75 percent of jobs within the state were taken by graduates from law schools within the state or an adjacent state. But with several schools in adjacent states not counted in the tallies because these states were not one of the top three states for employed graduates from those schools, one could infer that were graduates from all schools from adjacent states included the percentage might exceed 75 percent. (Notably, 13 of the 15 states with less than 67 percent of jobs taken by graduates of the law school in the state or law schools in adjacent states are states with modest populations and only one law school (or no law school) – Alaska, Delaware, Hawai’i, Idaho, Maine, Montana, Nevada, New Hampshire, New Mexico, Rhode Island, South Dakota, Vermont, and West Virginia.  The other two states are Utah and Virginia. The District of Columbia also falls into this category.)

LOCATION MATTERS -- In sum then, location matters. For the vast majority of law students at the vast majority of law schools, the vast majority of reasonable employment prospects associated with going to a given law school are going to be in the state in which the law school is located or an adjacent state. In the absence of a unique or specific aspect of a law school's program that might make a particular law school very appealing, this suggests that location should matter when considering a law school, perhaps more than ranking.

For example, if a prospective student has a choice between going to a higher ranked regional law school in a state in which the student does not anticipate practicing or living (and perhaps paying more in tuition), or a lower ranked regional law school in the location in which he or she hopes to live and work professionally (and perhaps paying less in tuition), the prospective law student should give serious consideration to attending the lower-ranked regional law school in the location in which he or she hopes to live and work professionally. This will make it easier to begin networking while in law school and to facilitate employment opportunities in the region in which the student is interested in practicing law and living. (And it may help the prospective student save money if the lower-ranked regional school happens to cost less (if it is a public school, for example), or if the prospective student has a more competitive LSAT/GPA profile at the lower-ranked regional school such that the student may be eligible for a scholarship.) 

[Posted by Jerry Organ]

September 3, 2012 in Data on legal education, Data on the profession | Permalink | Comments (7)

Thursday, August 16, 2012

UPDATED Comparison of 2010 and 2011 Enrollment and Profile Data Among Law Schools

    The initial posting I made on August 9 was based on a “composite” database consisting of information gleaned over several months from different sources – initially from law school webpages, supplemented with information from U.S.News (when LSAT or GPA datapoints were not available on webpages) supplemented more recently with information from the ABA-LSAC Guide 2013 to fill in any remaining gaps (enrollment data and some medians). At the time of posting, I had not gone back through all the data for all the schools to cross-check against the data in the ABA-LSAC Guide 2013 and eliminate any data discrepancies (although I thought I had done so for the schools listed in the chart).

    A number of people have asked for the complete spreadsheet.  I have now gone back and compiled the complete spreadsheet using data solely from the ABA-LSAC Guides for 2012 and 2013. I have provided the complete spreadsheet, organized alphabetically, to the folks at Law School Transparency where it is now or will shortly be available for viewing.

    The macro points remain fairly consistent with a couple of small changes. Working with the 194 schools in the contiguous 48 states and Hawai’i originally included in the U.S. News and World Report database (excluding the three Puerto Rico schools), the new database using only data from the ABA-LSAC Guides for 2012 and 2013 shows the following:

PROFILES IN DECLINE -- Between 2010 and 2011, 114 law schools had a decline in their LSAT/GPA profile, 55 had an increase in profile, and 25 had a mixed profile.

ENROLLMENT IN DECLINE – Between 2010 and 2011, 142 law schools had a decline in enrollment (of which 65 had a decline of 10% or more), 29 had an increase in enrollment (of which 8 had an increase of 10% or more), and 23 had flat enrollment (within +/- 1% of 2010 enrollment). This means over 70% of schools had a decline in enrollment and that one-third had a decline in enrollment of 10% or more. The decline in enrollment totaled roughly 4100 students or roughly 8 percent.

ENROLLMENT AND PROFILES IN DECLINE – Most significantly, 81 schools (slightly over 40%) saw declines in enrollment and in their LSAT/GPA profiles, of which 39 schools saw declines in enrollment of greater than 10% and saw declines in their LSAT/GPA profiles. These 39 schools are highlighted here Download 2011-2010 Comparison August Version abalsac dataset Detailed LSATandGPA 39 schools

(This updated chart reflects one subtraction and two additions from what was originally posted. Charleston was incorrectly included in the initial chart (resulting in 38 schools being listed) and now has been removed. Its enrollment was down only 5.4%. (In the composite dataset with which I had been working its 2011 enrollment and profile was initially based only on full-time students, overstating the percentage decline). Baylor and Willamette were not included in the initial chart, but are included here. Baylor’s total first-year enrollment is hard to estimate off its webpage because of three admissions cycles, fall, spring and summer and uncertainty about which three “count” for a given year. Willamette had a slight change in enrollment from 146 (listed on its webpage) to 141 in the ABA-LSAC Guide. This change shifted it from a decline of less than 10% to a decline of slightly more than 10%. I have apologized to Dean Abrams at Charleston for my error in including Charleston in the initial chart.)

[posted by Jerry Organ]

August 16, 2012 in Data on legal education | Permalink | Comments (2)

Wednesday, August 8, 2012

Comparison of 2010 and 2011 Enrollment and Profile Data Among Law Schools

A recent posting by Paul McGreal at The Faculty Lounge and an article in the National Law Journal by Matt Leichter (discussed in July here on the Legal Whiteboard) raise issues about the enrollment challenges law schools began facing last year, are facing now, and likely will face next year.  This post summarizes the comparative data for the 2010 and 2011 entering classes covering the 197 schools ranked by USNews.

PROFILES IN DECLINE -- Between 2010 and 2011, 111 law schools had a decline in their LSAT/GPA profile, 59 had an increase in profile, and 27 had a mixed profile.  (A decline means across six possible data points, 75th, median, and 25th for LSAT and GPA, more scores went down then up; an increase means more scores went up than down; a mixed profile means the same number of scores went up as went down.  For example, if a school had an LSAT/GPA profile in 2010 of 160/156/153 and 3.82/3.65/3.45 and an LSAT/GPA profile in 2011 of 160/156/152 and 3.83/3.64/3.43, this would be a decline in profile – down on three parameters and up on one parameter.)   The average 75th LSAT has dropped from 160.2 to 159.9, while the average 25 LSAT has dropped from 155.2 to 154.3.  The median scores for the 75 and 25 fell from 160 and 155 for LSAT to 159 and 153.

ENROLLMENT IN DECLINE – Between 2010 and 2011, 141 law schools had a decline in enrollment (of which 63 had a decline of 10% or more), 30 had an increase in enrollment (of which 6 had an increase of 10% or more), and 26 had flat enrollment (within +/- 1% of 2010 enrollment).  This means over 70% of schools had a decline in enrollment and that nearly one-third had a decline in enrollment of 10% or more.  The decline in enrollment totaled roughly 4000 students or roughly 8 percent.

ENROLLMENT AND PROFILES IN DECLINE – Most significantly, 75 schools (roughly 38%) saw declines in enrollment and in their LSAT/GPA profiles, of which 37 schools saw declines in enrollment of greater than 10% and saw declines in their LSAT/GPA profiles.  These 37 schools are highlighted here -- (original chart has been deleted and replaced by an updated chart reflecting 39 schools as described in post on August 16).  Four of the schools are ranked in the top-50, while the other 33 schools are relatively evenly divided between the second-50, the third-45 and the alphabetical schools.  There is some geographic concentration, with five Ohio schools (plus Northern Kentucky), three Illinois schools and four of the six Missouri and Kansas schools on the list.  Notably, 16 of the 37 are state law schools, several of which are relatively low-tuition schools that should conceivably fare better in the current climate in which prospective students are increasingly concerned about the cost of legal education.

FORECAST FOR 2012-- Given that LSAC has estimated a decline of roughly 14.4% in the number of applicants for fall 2012, from 78500 to roughly 67000, and given that the decline has been greatest among those with higher LSAT scores, one should anticipate further declines in enrollment and further erosion of entering class LSAT/GPA profiles for fall 2012.  The admit rate will be the highest it has been this millennium, probably exceeding 75% and possibly exceeding 80% (after increasing from 55% to 71% between 2004 and 2011).

IMPACT FELT ACROSS THE RANKINGS CONTINUUM, BUT WORSE FOR LOWER-RANKED SCHOOLS -- While the decline in enrollment and in profiles was experienced across the board, it was more pronounced among lower ranked schools. 

-Among the top 100 schools, 55 schools (over one-half) had a decline in profile, while 67 (two-thirds) had a decline in enrollment, with 27 experiencing a decline in enrollment of 10% or more.  Notably, 35 schools saw a decline in enrollment and in profile (over one-third) of which 15 schools saw declines in enrollment of 10% or more and a decline in profile.  Overall enrollment was down roughly 6%.

-Across the bottom 97 schools then, 56 saw a decline in profile while 74 (more than three-quarters) saw a decline in enrollment, of which 36 (nearly 40%) saw a decline in enrollment of 10% or more.  Notably 40 schools saw a decline in enrollment and a decline in profile, of which 22 saw a decline in enrollment of 10% or more and a decline in profile.  Overall, enrollment was down nearly 10%.

[Posted by Jerry Organ]

August 8, 2012 in Data on legal education | Permalink | Comments (6)

Friday, July 27, 2012

Cool Infographic on the Legal Services Industry

A really compelling way to convey a lot of important information.  I continue to be blown away by the volume of innovation I am seeing, mostly around interconnectivity.  (H/T: Greg Voakes at Business Insider)

The New Lawyer - Trends that are reshasping the Legal Industry

[posted by Bill Henderson]

July 27, 2012 in Blog posts worth reading, Data on legal education, Data on the profession, New and Noteworthy | Permalink | Comments (3)

Monday, July 16, 2012

"The Toppling of Top-Tier Lawyer Jobs"

That is the title of a just-posted essay by Catherine Rampell at the NY Times Economix Blog.  She studies several years of the bi-modal distribution.  It is refreshing to have a capable journalist review the data and marvel at the strange ways of our industry.  

[posted by Bill Henderson]

July 16, 2012 in Blog posts worth reading, Current events, Data on legal education, Data on the profession | Permalink | Comments (0)

Sunday, July 15, 2012

A Picture of the Melting Right Mode

I created the graphic below to depict the shrinking right mode of the bi-modal distribution since its 2007 high water mark (measured in February 2008). 


[Note: The difference between the mean and adjusted mean in the 2011 distribution is due to the fact that law grads who fail to report their salaries tend to have have less lucrative employment; so NALP makes a prudent statistical correction --basically a weighted average based on practice settings.]

From a labor market perspective, the class of 2007 entry level salary distribution was extraordinary and anomalous.  Why?  Because we can safely assume that legal ability, however it might be defined, is normally distributed, not bi-modal.  So when such a distribution appears in a real labor market, something is significantly out of kilter. 

Why did the entry level market become bi-modal? As the legal economy boomed from the mid-90s through the mid-00s, many large law firms (NLJ 250, AmLaw 200) were trying to make the jump from regional dominant brands to national law firms.  For decades, going back to the early to mid-20th century, these firms followed a simple formula: hire the best and brightest from the nation's elite law schools. As they continued to enjoy growth, they reflexively followed that same formula.  Yet, by 2000s, the demand for elite law graduates finally outstripped supply. 

This micro-level logic ("let's not tinker with our business model") produced a macro-level bidding war.  This is how the right mode came to be.  Yet, because it was a macro-level phenomenon, clients, led by industry groups such as the Association of Corporate Counsel (ACC), reacted by saying, "Don't put any junior level lawyers on my matters --they are overpriced."  Outsourcing and e-discovery vendors have also eaten into the work that used to go to entry level lawyers.  So the volume of BigLaw hiring has collapsed, hence the melting of the right mode. For a more detailed overview, see NALP, Salary Distribution Curve.

Long Term Structural Change in Big Law

That said, it is not just the entry level market that is under stress -- the fundamental economics of Big Law are also changing.  Consider the chart below (from Henderson, Rise and Fall, Am Law June 2012), which shows that revenues per lawyer at AmLaw 100 firms has gone flat and moved sideways since 2007, breaking a pattern of steady growth that dates back to the pre-Am Law 100 days.

Amlaw25 years

Stagnant revenue is a source of enormous worry for law firm managers.  Without higher profits to distribute--and growing the top line is the usual profitability fomula--their biggest producers might leave, causing a run on the bank ala Dewey, Howrey, Wolf Block, etc.  So the dominant strategy now has nothing to do with entry level hiring.  Rather, the goal is to keep and acquire lateral partners with portable books of business.  After all, clients aren't protesting the value of most senior level lawyers. And seniors lawyers are plentiful, thanks to the excellent health of baby boom lawyers and the poor health of their retirement accounts. 

This strategy may work fine for this fiscal year, but over the middle to long term, BigLaw is going to get older and dumber.  Further, this dynamic produces substantial ripple effects on legal education -- albeit ripple effects that feel like tremors.


The long term solution -- for both law firms and law schools -- is for the price of entry level talent to come down to the point where young lawyers are more cost-effective to train.  And that price point is not $160,000.  This inflated pay scale (which has supported ever higher tuitions at law schools) only persists because large firms are deathly afraid of adjusting their salary scales and being labeled second rate.  So the solution is keep the entry pay high but hire very few law school graduates.  This is not a farsighted or innovative business strategy.

It's been 100 years since law firms engaged in sophisticated business thinking. And that last great idea was the Cravath System, which was method of workplace organization that performed expert client work while simultaneously developing more and better human capital.  See Henderson, Three Generations of Lawyers: Generalista, Specialists, Project Managers.   According to the Cravath Swaine & Moore firm history, published in 1948, the whole point of the Cravath System was to make "a better lawyer faster." 

I think the next great model for a legal service organization (law firm may not be the right term) likewise will be based on the idea that there is a large return to be had by investing in young lawyers. As my friend Paul Lippe likes to say, "When it appears, it will look obvious."

[posted by Bill Henderson]

July 15, 2012 in Current events, Data on legal education, Data on the profession, Innovations in law, Law Firms, New and Noteworthy, Structural change | Permalink | Comments (2)

Thursday, July 5, 2012

Which law schools lose the most when applicants decline?

This is a simple question of great practical importance to many law schools, yet very few law school administrators understand how to answer it.  Who would have thought that clarity would be supplied free-of-charge by an underemployed recent law school graduate? 

Matt_LeichterBut that is what is happening now, in "Tough Choices Ahead for Some High-Ranked Law Schools," an Am Law Daily essay written by Matt Leichter, one of the silver linings of the declining legal job market -- and there aren't too many.  Matt is a J.D.-M.A. in law and international affairs from Marquette University who passed the New York bar in 2008, finished his masters work in 2009, and then moved to the Big Apple as the bottom was falling out of the entry level market.  Unable to find conventional legal employment, Matt started doing freelance writing on law-related topics. 

With plenty of time on his hands, Matt turned his graduate-level quantitative skills to the task of analyzing a law school education market that seemed unsustainable.  Matt first put his analyses on display at the Law School Tuition Bubble.  His writings eventually attracted the attention of The American Lawyer, which has now published several of his data-driven essays.

Here is what sets Matt apart. 

  • He digs very deep for facts and, in turn, uses one of his biggest asset --time -- to build datasets that answer important and relevant questions
  • He is non-ideological.  Just facts and factual analysis.
  • He writes about complex technical stuff in an accessible, credible way

Matt has all the core skills of a truly great lawyer.  Finding no takers, the entire legal education establishment benefits by Matt channeling his time, energy, and considerable intellect into relevant topics crying out for dispassionate analysis.

His "Tough Choices" essay is a real gem.  Here is the bottomline:  This year's applicant cycle likely will deliver its greatest blow to US News Tier 1 schools who generally admit students who were angling to get into even higher ranked schools.  This inference can be teased out of the ratio of applicants to offers (selectivity), and offers to matriculants (yield).  

To conduct this analysis, Matt had to cull data, school-by-school, from several years of the ABA-LSAC Official Guide to Law Schools (aka "the Phonebook"). But it enables him to produce the chart below:


What this chart says is that admissions officers have to read more applications and make more offers to fill their entering classes.  Based on the data in Matt's chart, in 2004, for all ABA-accredited law schools, there was a 24% acceptance rate, and a 31% yield from those offers.  In 2010, the acceptance rate went up to 31% (schools were being less selective) and the yield went down to 25% (fewer showed up to enroll). 

Applicant volume may be declining, but the trends above suggest that there is a lot more "competitive shopping" going on. Why? Because information costs are going down and prospective students are adapting.  And this year is bound to be the most aggressive year ever.  According to this NLJ story, It's a Buyers' Market for Law School, virtually every student is now negotiating for scholarship money.

Declining applicant volume, shifting yields, and highly informed consumers make it very difficult for law school administrators to lock in their LSAT and UGPA numbers, which schools generally fixate on because of U.S. News ranking.  This produces pain in one of three ways:

  1. The school shrinks the entering class (announced by at least 10 schools), which severely tightens the budget
  2. The school buys its class through financial aid, which blows a hole in the budget (happening here)
  3. The school significantly relaxes the LSAT and UGPA and braces for a drop in the rankings because its peers are pursuing strategies #1 or #2.

#1 and #2 may seem like the prudent course, but a central university won't (more likely can't) provide a financial backstop for more than a year or two, if that.  If the admissions environment does not change dramatically, which seems unlikely, some combination of layoffs, rankings drop, or closures will have to be put on the table.

Matt's ingenuity is on full display when he demonstrates, with data, the profile of the most vulnerable schools -- and its a far cry from the bottom portion of the U.S. News rankings. 

  • Low accept/high yield (think Yale and Stanford) are safe. 
  • High accept/high yield are also fine.  They are nonprestigious but have strong regional niches or missions. Tier 3 or 4 designation means nothing.
  • Low accept/low yield crowd -- a bunch of Tier 1 schools -- are vulnerable to significant rankings volatility.  If they drop, next year's applicant volume will be affected, making it very difficult to rebound.
  • High accept/low yield are the most likely to close.

Until August and September, when the wait lists finally clear, nobody really know the depth of market shift.  Only then can the budget holes be finalized.  Deans will then have candid conversations with their central administrations to answer the question, "Is this downward trend permanent?"

[posted by Bill Henderson]

July 5, 2012 in Blog posts worth reading, Current events, Data on legal education, Important research, Structural change | Permalink | Comments (1)

Monday, July 2, 2012

The Client-Focused Lawyer

[by Bill Henderson, originally published in The National Jurist, January 2011 (PDF)]

Over the last three years, the majority of my research has focused on lawyer competencies, or what I prefer to call lawyer success factors.  This research has fundamentally changed my perceptions of legal education, primarily because the majority of success factors are not taught, assessed, or measured during law school.  It is not that we law professors are deliberating ignoring something important.  Rather, we are not even aware that something beyond legal knowledge and technical skills are necessary for success.  

Based upon my own observation, and a fair amount of time sifting through data, I think the single best predictor of both success and satisfaction as a lawyer is the ability to become truly client focused.   Unfortunately, this client-focused mindset is completely absence in the large law school classes that are the core of the law school curriculum.

Continue reading

July 2, 2012 in Data on legal education, Data on the profession | Permalink | Comments (0)

Seduced by Legal Brands

[by Bill Henderson, originally published in The National Jurist, September 2011 (PDF)]

Every year as the on-campus interview process gears up, another class of high performing law students fret over their chances of getting an offer from a cadre of firms that, a year earlier, they had never heard of.  The thought process goes something like this.  “Oh, these types of firms pay a lot of money.  And among these firms, some are harder to get hired at than others – they are more prestigious.  If I can land a job at one of these firms, the entire legal world will know that I am smart.  That would feel great.  And I can quickly pay off my student loans and keep my options open.” 

Money and peer pressure are a potent mix.  They make it virtually impossible to remember the original reason for applying to law school.

During the bubble of the late 1990s, I was a student at the University of Chicago Law School.  In the classroom, I was deeply intimidated by my classmates.  But as we ploughed through the OCI process, I was astonished to see my fellow students anguishing over Skadden versus Latham.  Or gnashing their teeth that they might have missed the Chicago grade cutoff for Gibson Dunn.  Weren’t these firms more alike than they were different?  And what made them so great beside the relative difficulty of securing a callback? 

The prevailing analysis during OCI seemed shallow and bereft of reliable facts. We were taking our cues from each other.  Yet, I could sense my own irrational desire to compete and win.  I wish I could say that I was smarter than my classmates.  But that’s not true.  I was just older, and life had already thrown water on my face.

Continue reading

July 2, 2012 in Data on legal education | Permalink | Comments (0)

Is a Great Lawyer Born or Made?

[By Bill Henderson, originally published in The National Jurist, January 2012 (PDF)]

Many law students spend their 1L year fearing that they might be the admissions mistake.  I was one of them.  The only feedback is what can be gleaned from the professor-student dialogue.  In turn, everyone uses this information (if you can call it that) to handicap their likelihood of making law review or otherwise getting the grades needed to get the most coveted jobs.  The whole process seems very binary:  Am I smart enough to be a successful lawyer, yes or no?

When I became a law professor, my research on law firms and legal education eventually brought me to the topic of lawyer success.  I started collecting examples of lawyers with sterling credentials who failed to develop a significant practice; and those with less impressive pedigree who ended up becoming go-to experts and indispensible lynchpins of their organizations.  What explained these divergent outcomes?

The research of Carolyn Dweck, a cognitive psychologist at Stanford University, provides some important insights to this question.  Before delving into these insights, however, ask yourself whether the following statement is true:  “A lawyer’s skill set is determined primarily by innate ability—you either have enough or you don’t.”

Continue reading

July 2, 2012 in Data on legal education, Data on the profession, Important research | Permalink | Comments (0)

The Inferiority Complex of Law Schools

[by Bill Henderson, originally published in The National Jurist, March 2012 (PDF)]

For over a century, law schools have suffered from an inferiority complex.  We have masked it well, but its consequences are finally coming home to roost.  Like most psychological conditions, our lives will be much better and healthier when we deal with its root cause.  Further, when law students understand this history, they will better understand the changing nature of the legal economy.  They can even help law schools with the cure.

In 1918, the renowned economist Thorstein Veblen famously quipped, “the law school belongs in the modern university no more than a school of fencing or dancing.”

Veblen, like many of his academic colleagues, believed that universities should be citadels for science-based learning and the production of knowledge.  Law, in contrast, was a trade. Indeed, in the early 1900s, a substantial portion of the practicing bar had obtained their skill and knowledge through office apprenticeships.  When law schools did begin to appear, they were just as likely to be proprietary law schools operating out of a local YMCA than to be part of an established university.

Despite the skepticism of the academic class, there were a host of practical reasons for universities to create (or, in some cases, acquire) a law school.  First, the law was the primary occupation for many elected officials, which held out the prospect of reflected glory.  (Veblen recognized this motivation, which compounded his worry.)  Second, a handful of law schools at prestigious universities had begun adopting the so-called case method, which purported to find objective legal rules and principles akin to a scientist working in a laboratory.  The perceived rigor of the case method provided at least a veneer of science.  Third, with their large lecture halls filled with tuition-paying law students, law schools made money.

Continue reading

July 2, 2012 in Data on legal education, Innovations in legal education | Permalink | Comments (1)

Tuesday, June 26, 2012

These Data Will Fundamentally Reshape the Legal Education Industry

Just a few days ago, the ABA Section on Legal Education and Admission to the Bar posted on its website, in downloadable spreadsheet format, the employment outcomes for the Class of 2011 (here). In a few short years, these data are going to fundamental reshape our industry.  The changes will make the industry better and stronger, but the journey to this better place is going to painful and disorienting for all law schools—that’s right, even the elite national law schools will be affected.

This is worth explaining in very simple and concrete terms.  The Class of 2011 employment data consists of 134 variables on 200 ABA-accredited law schools-- 26,800 discrete data points, which is enough fill a phonebook.  For a long time, the policy of the ABA was to do just that – publish a phonebook of data in the form of the ABA-LSAC Official Guide to Law Schools.  Well, decisions on where to attend law school are not free.  They require time and effort.  When a prospective student has to wade through a phonebook to assemble relevant data to make important decisions, many (most) will forgo the exercise altogether. 

This has two very important effects:

  1. The quality of enrollment decisions goes down because, from the student perspective, the costs are too high.  That’s error #1.  But it is forgivable—decisionmaking is a skill taught in a top-notch legal program, not a prerequisite for applying.
  2. To simplify their decisions, students gravitate to U.S. News ranking, which is a compact 4-page table that contains easy-to-understand comparative data. 

Yes, the U.S. News has serious flaws; and every year, overreliance on them produces tragic consequences in the form of excessive student debt.   Now, with the ABA employment "phonebook" in spreadsheet format, those a with modicum statistical skills and an internet connection can analyze, simplify and publish relevant statistics that will better inform the decision to attend law school. 

Consider the chart below:


When I created this simple pie chart, I started with a simple premise: If I am applying to law school, my minimum hope is that nine months after graduation I will be able to obtain a full-time, permanent professional job.  The phonebook has three columns of data that speak to this hope:

  1. Bar Passaged Required Jobs, FTLT (i.e., Full-time, Long-Term)
  2. JD-Advantage Jobs, FTLT
  3. Professional Jobs, FTLT. 

All the other myriad data columns, parsing things by part-time, short-term, non-professional, unemployed, unknown, etc., do not meet the minimum hope.  So they are lumped together as “Other Outcomes.”  Clearly, for 1/3 of the Class of 2001, their full-time, permanent professional ambitions have not yet materialized. 

A reasonable next question is how these figures vary by U.S. News rank. The answer is reflected in the chart below.


Some observations:

  • Least surprising. The outcomes are better at “national law school”--almost 90% are FTLT professional jobs.  I used the T14 cutoff because the composition of this group has not changed in two decades of U.S. News rankings. Few people would disagree that these schools have strong pull among legal employers.
  • Most surprising.  There is a whole lot of Purple--i.e., “Other Outcomes”--throughout Tiers 1, 2, 3, and 4.  For over 90% of law schools, this is a very challenging legal market.  
  • Biggest reality check.  The JD-Advantaged and Professional jobs appear to be, on balance, less desirable than those requiring bar passage. They increase nearly three times in relative proportion as we move from T14 to Tier 1 to Tier 2.  Many are likely compromise jobs—not as good as practicing law, but better than non-professional alternatives.

With these relative benchmarks in place, a prospective law student can look for law schools that are outperforming their U.S. News rankings.  And there are quite few. 

For example, in Tier 4, St. Mary’s (Texas) has 78.3% Bar Passage Required placement; Mississippi College’s figure is 75.3%; and Campbell (NC) is 71.4%.  These schools aren’t feeding BigLaw, but their graduates appear to be full-time practicing lawyer nine months after graduation.  What accounts for their success? Most of their graduates are probably in cities and towns far away from corporate practice.  Nonetheless, these schools have a clear niche they are filling.

In contrast, there are 20 schools in Tiers 1 and 2 that have less than 50% Bar Passage Required jobs.  What do they have in common?  Many are in big cities in the Northeast and Mid-Atlantic or California--large urban markets that are attractive for young professionals.  It is likely that too many young lawyers are chasing after a finite set of legal jobs.  It is worth noting, however, that these same schools also have rates of placements in JD Advantage and Professional jobs that are higher than other law schools at statistically significant levels. 

So many young law graduates are voting with their feet.  Better to stay in the city as a non-lawyer professional than to move to the South to be country lawyer doing small firm practice.  Although I suspect a large proportion of these grads will fare quite well, it is important to keep in mind that JD-Advantaged and Professional jobs are not a panacea—they are also in short-supply.  At most schools in Tiers 1, 2, 3, and 4, between 30% and 42% of graduates are either unemployed and underemployed in jobs that are either nonprofessional, part-time, or short-term.   Indeed, 4.3% (1,874) of all jobs for the Class of 2011 were funded by the law schools themselves!

As I have said previously (here and here), the current legal job market reflects a structural change in the legal sector—these numbers aren’t going to turn around in a year or two.

So what is going to happen?  Notwithstanding the heady optimism of the “Kaplan kids”, the ABA employment data, thanks to the blogosphere, is going to reduce information costs, making it easier for prospective law students to determine whether law school is a good investment.  The needle is going to move, just not as fast as a Chicago School economist might predict.

Further, expect students to aggressively negotiate for scholarship money.   Whether schools become more generous in merit aid, admit fewer students, or both, all signs point to shrinking budgets for law schools.

The utter transparency of a changing and stagnant legal market has potentially more dire consequences for law schools.  The lifeblood of the entire legal education establishment, including elite law schools, is federal student loans.  Our students get the same generous terms as graduates of medical and dental schools, who are not struggling to make six figure incomes.  The graphs above suggest that a large proportion of our students will be on Income-Based Repayment (IBR), which is – functionally – insurance in the event a high income fails to materialize in the years following graduation.  The downside risk of that insurance – lack of repayment of expected principal and interest—is borne by U.S. taxpayers. 

Right now, it is possible to estimate the size and probability of this downside risk. All the Federal Government has to do is add-up the shortfall between the repayment of principal and interest in normal repayment versus the monies actually being collected.  What percentage of graduates are on IBR?  What portion of their current principal and interest are they able to pay?  These are simple numbers that some enterprising journalist will eventually request. Further, they are legitmate public policy questions that we, the legal academy, should face long before the journalists get there.

Lawyers and law schools are not a favored interest group on Capitol Hill.  We need to plan for the extremely high probability that the financing of law schools will be dramatically altered in the years to come.  The longer we wait, the more painful and disastrous the transition.  Every law school will need a damn good story to justify continued federal loans.  And right now, many of us lack that story – being in Tier 1 or T14 (where debt loads tend to be the highest) won't mean anything if the math falls short.

In summary, our ivory tower is crumbling.  With the ABA putting the employment data in downloadable format on its website, law schools will have to do something completely new and scary to us—we are going to have to compete to keep our jobs and stay in business.  The litmus test is going to be the ability of our graduates to obtain remunerative professional work in a highly competitive global economy.   This is very serious work.

[Posted by Bill Henderson]

June 26, 2012 in Current events, Data on legal education, Structural change | Permalink | Comments (8)

Saturday, May 19, 2012

"Graduates Shun Legal Profession"

ShunprofessionThat's the headline of a story in the Sunday edition of The Age, one of Australia's leading daily newspapers.  Here is the nut:

ALMOST two-thirds of Australia's law graduates are not working as lawyers four months after they have completed their degrees, according to a study.

The Graduate Careers Australia survey of 1313 recent graduates from all over the country found that 64 per cent were not practising law between 2010 and 2011.

There was ''no way'' law firms could accommodate all the graduates from Australia's 31 law schools, La Trobe University's director of undergraduate studies, Heather King, said. ''It's a well-acknowledged fact that 40-50 per cent will not end up in a traditional law practice.''

These statistics may seem even bleaker than those that describe the U.S. legal market.  Yet, for two key reasons, these Australian students are far better off. First, the Australias follow the LLB model, which has some substantial advantages.  According to my Australian colleagues, a law undergraduate degree is often combined with a major in another field or discipline, such as business, accounting, sociology, or literature.  So a student's commitment to law as career is often tentative and, in many cases, hedged by another career interest.  Second, higher education in Australia enjoys a large national subsidy.  So law graduates typically graduate with little or no debt.

Ironically, as the story reports, some Australian universities are moving toward the J.D. model, essentially concluding the law is best taught to more mature students as a graduate discipline.

I agree that students ought to have a cost-effective way to opt out of law.  I also agree that law is best taught as a graduate discipline to students with some substantial life experience.  I don't, however, see an easy way to cost-effectively achieve both. The fact that the solution is not easy will, conversely, make the solution quite valuable.

[posted by Bill Henderson]

May 19, 2012 in Cross industry comparisons, Data on legal education, Data on the profession, New and Noteworthy, Structural change | Permalink | Comments (0)

Monday, May 14, 2012

Review of Failing Law Schools, by Brian Tamanaha (Part I)

Failinglawschools[Update: I edited the review below to remove three paragraphs from my analysis.  It was a metaphor that was not key to my review of Brian's book yet could be fairly viewed as insulting to readers I both respect and hoped to persuade.  I am sorry about that. It was a substantial change, so I am acknowledging it here. wdh.]

Many legal academics are going to dismiss Brian Tamanaha's book, Failing Law Schools, without ever reading a page.  A larger number may simply ignore it.  That is ironic, because this is the response one would expect if Tamanaha's account of a corrupt, self-indulgence academic culture were true. 

I have lived inside this culture since I joined the academy in 2002. And I can attest that very few people inside the academy believe that we are living the high life on the backs of our students. But in the year 2012, that perception does not matter very much.  Rather, the perception that matters is the one from the outside looking in. 

Over the last eighteen months or so, The New York Times, The Wall Street Journal, The Washington Post, The Atlantic, the legal press and countless blogs (many written by unhappy students) have relentlessly hammered away at law schools.

The  lay public, including most practicing lawyers, are looking for a definitive account that can explain the legal education's maelstrom.  Tamanaha's account is a veritable Brandeis Brief on what went wrong, chocked full of facts and history and persuasive analysis. 

It begins with a deal between the ABA and AALS to join forces to persuade the state bars to restrict entry to ABA accredited law schools (the ABA's goal) and thereby to elevate the stature of the legal professoriate (the AALS's goal).  Once this deal was struck -- in the early 20th century -- pretty much every change accrued to the benefit of the law faculties: higher salaries, lower teaching loads, the advent of administrators to lighten the burden of governance, and more freedom to pursue scholarly interests.  When U.S. News & World Report ranking appear in the early 1990s, the law schools are forced to make choices.  And our collective behavior suggests that vanity and prestige are all-too-likely to trump important principles like student diversity or honesty in reporting data.

For us law professors, here is our conundrum. From the outside looking in, things look bad, even corrupt.  Yet we don't feel we have done anything wrong.  We are certain that we lack the intent to cheat or defraud.  But that, unfortunately, is error #1.  As we all know, establishing intent is always a matter of circumstantial evidence.  So let's review that evidence from the perspective of the neutral fact finder.

Life is objectively good for us:  We have high salaries, social prestige, lots of travel, job security, and near absolute freedom to organize our time outside the three to six hours a week we teach, 30 weeks a years.  Against this backdrop, there is consensus among legal employers that we are not very good at practical training including, in the eyes of many, basic legal writing.  Moreover, the overproduction of lawyers creates problems for the legal profession as a whole.  Similarly, our students  are saddled with enormous debt and nothing we are doing curricularly seems geared to solving their burgeoning unemployment  or underemployment problem.  The federal government finances this "system."  And through Income-Based Repayment programs, the U.S. taxpayers are backstopping our high costs.

Because law faculty seems to be getting the long end of the bargain here, our subjective feelings of honesty and rectitude are unlikely to be viewed by many students, practicing lawyers, or the broader public as credible.  In fact, they may be viewed as insincere or out of touch.  How did things get so badly out of kilter? 

But for Tamanaha, some pesky journalists, angry students, and the ticking time-bomb of law students debt, I am confident that we law professors could coast along on our present track for another several decades.  As an insider, I can honestly testify that we believe--sincerely beheve--that we care about our students, the quality of their education, their debt loads, and their future job prospects.  But  looking at the same set of facts, history will draw its own conclusions. And Tamanaha, akin to a lawyer building a case, offers up a very compelling narrative that the dispassionate observer is likely to find convincing. 

Other bloggers and news outlets have commented on Tamanaha's book, often drawing very different conclusions. Compare Brian Leiter's Law School Updates and Orin Kerr at Volokh Conspiracy (Tamanaha's argument has merit, particularly when he suggests that lower ranked law schools should consider changing their models), with Scott Greenfield at Simple Justice (here and here) (Tamanaha describes an insular, out-of-touch professoriate from the top down that distains the input of practicing lawyers) and the Chronicle of Higher Education (subscription req'd)  (describing Tamanaha's thesis, "Law schools are bloated with too many underworked, overpaid professors whose salaries are supported by tuition increases that are making law school a losing bet for many students").

What are the proper inferences to draw? 

In late 2011, I reviewed a copy of Tamanaha's book as part of the peer-review process for University of Chicago Press.  My primary advice to Brian, communicated directly to him as well as his editors, was "to condemn the sin, not the sinner."  Legal academics may seem culpable for privileging their interests ahead of students, I said, but these are the same folks who need to be relied upon to fix the problem. (The alternative is that nearly all of U.S. legal education will collapse under the weight of high costs and fewer entry level legal jobs; and on many days, I think the latter is just as likely as the former.)  

Frankly, I don't know if my "condemn the sin, not the sinner" recommendation was good advice.  In order to change, the legal academy may need more pressure brought to bear from outside forces. This may happen if the legal academy is painted as more selfish, insular, elitist and out of touch than we already look now.  Congress and the Department of Education hold the ultimate trump card, and Tamanaha's book provides the essential supporting evidence for radical action.  If and when this happens, law faculties will be forced to pick sides.  

History is now playing out right before our eyes.  I believe there is a good chance that Brian Tamanaha's book will be viewed--by history at least--as a great act of courage.  The implication, of course, is that the rest of us will look foolish.

Brian discusses the bleak employment prospects of law schools, but (through no fault of his own) understates the nature of the structural change that is occuring in the U.S. and global market for legal services.  In Part II, I will write about some logical next steps for law schools looking to get ahead of the coming tsunami. 

[posted by Bill Henderson]

May 14, 2012 in Current events, Data on legal education, Data on the profession, Scholarship on legal education, Structural change | Permalink | Comments (6)

Sunday, March 25, 2012

Unsustainable Law Student Debt

TamanahaAt Balkanization, Brian Tamanaha (Washington University) continues to shine a bright light on law student loan statistics.  See The Quickly Exploding Law School Debt Disaster

Viewing recently released 2011 data, Brian cites 17 law schools where the average debt exceeds $135,000 per student.  The vast majority of students at these schools will be forced into Income Based Repayment (IBR), which is, functionally, a federally administered insurance program for indebted law school graduates who fail to make a high five-figure or low six-figure income. It caps debt payment at 15% of income above some basic poverty level threshold. (In future years, it will drop to 10%.)  The downside of IBR is that unpaid interest is quickly capitalized, so a graduate's total debt load explodes upward, making it very difficult to afford things like a car or a home using debt finance. Then, as Brian suggests, buyer's remorse is going to set in for a whole generation of law school graduates. 

As a political issue, this is not going away.  I agree 100% with Brian's final line:  "This financial insanity will not stop until significant changes are made to the federal student loan program."  When this happens, every law school in the U.S. will be be affected.  As I said last week, it is time we get our houses in order.

[posted by Bill Henderson]

March 25, 2012 in Blog posts worth reading, Current events, Data on legal education, Structural change | Permalink | Comments (0)

Saturday, March 17, 2012

A Reply to the Empiricists at NWU Law

My blog post from last week, "Too Good for BigLaw: The Statistician Edition" has resulted in a minor kerfuffle with some of the distinguished empiricists at Northwestern Law.  See Dan Rodriguez, Law School Sorting and the Partnership Track:  Northwestern Empiricists Weigh In, Word on the Streeterville [The Blog of NWU Law Dean].  NWU Law folks were not impressed with my analysis.  Dan Rodriguez was gracious enough to send me the link at the same time his post, quoting the views of his colleagues, went live.  He has also encouraged me to reply publicly. 

I am happy to do that.  Let me start with big picture issues.  Then, for those folks with the curiousity and stamina to wade through arcane details--and experience tells me this is a small group--I will directly address, point by point, the the issues raised by Kate Litvak and Max Schanzenbach.  But at the outset, I will say that I am not conceding any ground.

Big Picture

First off, it is important to understand why this topic generated so much traffic.  See Above the Law, ABA Daily Journal, TaxProf, InstapunditAdam Smith

It all started with a provocative blog post by Vivia Chen, the columnist for The Careerist.  Vivia reviewed hiring and promotion data from the NLJ 250 Law School Hiring Survey and noted that elite law school graduates were becoming partner in very low numbers when compared to the hiring pipeline. Vivia editorialized on the numbers in a way that played into readers' fragile egos and insecurities.  Of course, that is her job, which she does very well.

In a nutshell, here is why people care -- or more precisely, get anxious -- about this topic:  it is conventional wisdom that graduation from elite law schools produces better career outcomes.  When that expectation is countered by actual marketplace data, people are surprised.  See, e.g., Bruce MacEwen,  "The Best & The Brightest" at  Adam Smith Esq. (leading blog on law firm economics).  Surprise is the first reason this issue got so much play.  Emotion is the second.

Emotion matters because very few lawyers and law professors are dispassionate on this topic.  When it comes to conventional wisdom on law school pedigree, we all have horses in the race.  Because we are human beings, we lawyers and law professors don't wait for balanced market data to develop our own entrenched worldviews.  When the conventional wisdom favors us, we go with it -- albeit we aren't really conscious this is happening. So when data upset the apple cart and potentially make us look complacent, our passions get aroused. 

The folks at Above the Law have built a entire business model around such predictable lawyer foibles.  The more chum thrown in the water, the higher the ad revenues.  It's just that simple.

Vivia's primary point, stated through metaphor, is that regional schools (such as Chicago Loyola) seem to be making partner at higher rates than the elite schools (such as Chicago).  This is a reasonable inference because the ratio of associates hired to partners promoted appears to be consistently high for elite law schools and very low for a large number of regional law schools.  This very point was made independently by Bruce MacEwen, who is a very sophisticated guy who advises law firms on strategy.

That said, there was ample opportunity for readers to draw spurious inferences from Vivia's metaphor-driven blog post.  Thus, to avoid any school-specific claims (a 1-year crossectional sample is not suitable for such a purpose), I pooled the schools by U.S. News ranking, drawing a line between elite and non-elite at the T14 mark.  Why T14?  Because these schools have played a closed loop of musical chairs for 20 years in the U.S. News rankings.  These schools would be viewed by most employers as "national" law schools.  

Here is what the data showed:

  • Pipeline in:  53.7% T14, 46.3% non-T14
  • Partners Promoted: 29.4% T14. 70.6% non-T14.

That is, well, an enormous skew. In 2011, for every 5.43 elite grads hired, a senior associate from an elite school makes partner.  For non-elite schools, that corresponding statistic is 1.95.  Vivia found these numbers surprising and somewhat counter-intuitive.  So did Bruce MacEwen, Above the Law, ABA Journal, etc.

There are ways to break down these numbers to gain additional insights, but the key point here is one of magnitude.  Elite law graduates are supposed to be smarter and more capable -- no one expects these folks to be on short side of any race, tournament or desired outcome.  The magnitude of hiring/promotion gap is the surprising fact that needs to be explained.

I had observed roughly the same skew several years ago (pooled 2007 and 2008 data) and alluded to it in this article, "Why is the Job Market Changing," Nat'l Jurist (Nov. 2010).  I also follow other relevant studies, such as The After the JD, which have noted differences between elite and non-elite graduates.   So I had a head start in thinking through possible explanations. I thus offered five theories, all of which could work in concert, to explain the large skew in the data:

  1. Selection effects
  2. Differences in first jobs
  3. Intergeneraional privilege
  4. Influence of admission criteria on the associate pipeline
  5. "A Better Plan B" for elite grads

So, to be very clear, I am not using the NLJ 250 data to support the above theories.  It is the reverse: I am offering the above theories as a likely explanation for the very large skew between elite and nonelite grads.  Framed as a open-ended research question, it might be written, "why are elite grads not becoming BigLaw partners in numbers commensurate with hiring patterns and general presumptions of their higher ability?"  That is a mystery and a puzzle.

Statistics Minutiae  [After the jump ...]

Continue reading

March 17, 2012 in Blog posts worth reading, Data on legal education, Data on the profession, Law Firms, New and Noteworthy, Scholarship on legal education, Structural change | Permalink | Comments (3)

Friday, March 9, 2012

"Too Good for BigLaw": The Statistician Edition

ViviaMy good friend and provocateur Vivia Chen has posted a stir-the-pot column on the recent NLJ 250 Law School Hiring Survey.  The title of the column, "Too Good for BigLaw," is classic Vivia, speaking to our fragile egos as people and lawyers.  Reviewing the data on associates hired and partners promoted by law school, Vivia notes a significant shortfall in the number of elite law schools who become BigLaw partners.  One theory, suggested by Vivia, is that elite law school grads must have better options.  Regardless, the hierarchical nature of the legal profession may not be so neatly ordered after all.

I am confident that Vivia's column will create a wellspring of indignation among several thousand people who want to believe that getting into a fancy law school makes them permanently special.  And if they aren't special, the ruler must be broken.  I am the original source of the numbers, so I feel an obligation--albeit not a very big one--to reduce the anxiety level.  So below I wrote out a more dispassionate explanation of the numbers.  This is the Statistician Edition of "Too Good for BigLaw."

Vivia's Interpretation. 

The first point of clarification is that "Too Good for BigLaw" is one interpretation of the data -- one that is plausible, but others are plausible and perhaps more likely.  The virtue of Vivia's spin is that is gets your attention so she can make a simple, accurate point:  elite law school admission does not translate into Big Law partnership.  But one line is pure metaphor:  "If you want to make a safe bet ... put your money on the hardworking stiffs from ... Chicago—Loyola [rather than the 'wunderkids' from U of Chicago]."  If you are fixated on the literal, let me assure you that lots of other factors tend to intervene on the journey from law school to partner.  Hang on.  Don't panic. 

Limitations of the Data

The NLJ 250 Law School Hiring Survey is what is called a "cross-sectional" sample.  Think of a cross-sectional sample as a photo snapshot.  And, as life teaches us, snapshots can be misleading.  For example, if I said I was handsome in my 20s, ten photographs (one per year randomly drawn) would be more persuasive than a single phone.  (Given my druthers, I would prefer you look at the photo from my sister's wedding, where I was wearing a tuxedo and had a nice summer tan.)  Because snapshots are subject to random variability, the inferences to be drawn have to be properly cabined and qualified. 

In the case 2012 NLJ 250 data, we lack a reasonable basis for making strong school-specific claims. So, to be crystal clear, we cannot draw the inference that Chicago-Loyola is a better partnership bet that University of Chicago.  To draw stronger, more reliable inferences, we would need to average across multiple years. That said, if you doubt the accuracy of Vivia's regional-versus-elite law school metaphor, see Ted Seto, Where Do Partners Come From? (2011).

But What We Can Say?

Although it is improper to make (literal) school-specific claims from the 2012 data, it is possible to make stronger, more reliable inferences by pooling these data on observable school-level attributes, such as elite versus non-elite status based on U.S. News ranking.  This is appropriate because the school-level variability is, for the most part, random (good and bad years cancel each other out); and what is non-random (e.g., a economic recession) tends to apply to all law schools. 

Consider the following statistics on 2011 hiring and promotions of graduates of Top 14 versus non-Top 14 law schools (why T14? because these schools have played musical chairs in the U.S. News since the dawn of the rankings):

  • Associates hired: 1,769 (T14), 1,525 (non-T14), or 53.7% to 46.3%
  • Promotions:  326 (T14), 781 (non-T14), or 29.4% to 70.6%

Using the Associate hired/Partner Promoted ratio statistics referred to by Vivia, the ratio of associates hired to partners promoted is 5.43 for T14 versus 1.95 for the non-T14.  The ratio for all schools is 2.98.  So, there is a very large skew working against the elite law school grads.  The takeaway from these numbers is very straightforward.  There is a very big pipeline between T14 and BigLaw, but at some point before partnership, T14 associates tend to get off the train in disproportionately high numbers.

(A few readers may cling to the idea that one year's worth of data is not enough to draw the above inferences.  Maybe 2011 was a Black Swan, but please don't place any bets on it. I analyzed this same data four years ago and got essentially the same results.)

So Why Aren't the T14 Grads Dominating the BigLaw Partnership Ranks?

Good question.  Based on admissions criteria, these folks tend to have significantly higher test scores. And God knows, they enjoy a huge presumption of ability during law school recruiting--law firm hiring partners are incredibly brand-conscious. If partnership were the NCAA tournament, the T14 crowd would consistently be the number 1 and 2 seeds.

I have been thinking about this topic for several years.  Here are a few plausible theories, all of which can work in concert with one another.  Some are statistical, others are sociological:

1. Selection effects.  There are enormous selections effects at work.  In effect, we are pitting the #1 to 20 persons at Chicago-Loyola against anyone at U of Chicago.  It is unlikely that factors such as personality and motivation are identical in these two populations.  Another enormous selection effect is intrinsic interest in corporate law -- does anyone really believe that the 75% of Stanford, Penn or Harvard grads who start their careers in BigLaw have a burning passion to do technical, often times repetitive legal work for the Fortune 500? 

2. First jobs.  Elite graduates, whenever given the choice, tend to start at the most elite firms possible.  And, no surprise, these shops are the most highly leveraged and have the highest wash-out rates.  See Zaring & Henderson, Young Associates in Trouble (2008). But here is the big surprise: the next stop on the train is not somewhere else in the NLJ 250. These folks are not moving down; they are moving out.

3. Inter-generational privilege.  The After the JD study has documented that elite law school graduates tend to hail from more affluent families.  They also evince less interest in corporate law.  See Dinovitzer & Garth, Not that Into You, Am. Law. (Sept 2009).  When mom and dad are both lawyers, and grandpa owned a factory, maybe it's time to focus on art and travel.   In effect, one's inheritance becomes one's safety net.

4. Influence of admissions criteria.  Over the last 20 years, admissions committees have focused more and more on LSAT and UGPA; conversely, personal statements, letters of reference, and career histories hold very little sway.  This has fundamentally altered the BigLaw pipeline with students who are (excessively?) academic and lack significant brushes with real world adversity--not ideal grooming for a high stress professional service job.  I think these "supply chain" dynamics are uniformly overlooked by employers--big mistake.  Michigan Law circa 1982 is not Michigan Law circa 2012.

5. "A Better Plan B."  I know a lot of people in the law world will cling to the notion that elite law school graduates are running government agencies, leaving the law for Wall Street, and generally living very charmed lives.   I am sure there is something to this theory.  But I doubt it is carrying the load on the BigLaw associate/partner attrition puzzle.  My own class at U of Chicago (Class of 2001) has a broad assortment of legal careers -- but nothing too markedly different than many of the alumni of Indiana Law, where I teach.  Ten years out, lawyers from decent law schools tend to be having interesting careers -- with "interesting" being the core commonality.

Perhaps it is time we focused on the skills and attributes of successful law graduates rather than the name of the law school on their diplomas.  Law professors as a group are more alike than different.  Does anyone really believe that classes at an elite law school are much different -- let alone better -- than the instruction received at 100 regional law schools taught by professors from elite law schools? 

I think law schools can have a huge impact on the lives of students, but that is a strategy that  remains largely untapped.  And a topic for a future post.

[Posted by Bill Henderson]

March 9, 2012 in Blog posts worth reading, Data on legal education, Data on the profession, Law Firms | Permalink | Comments (18)

Wednesday, February 1, 2012

Legal Education's Ninety-Five Theses

Picture1Brent E. Newton, an adjunct professor at Georgetown University Law Center, has posted a legal education reform piece on SSRN, entitled The Ninety-Five Theses: Systemic Reforms in the American Legal Education and Licensure   [Hat-tip TaxProf].  Judging by his title, Newton is hoping to spur a Reformation of legal education, akin to what Martin Luther did for Christianity in the 16th century.  If that is his agenda, I will not stand in his way.  

According to his GULC web bio, Newton is Deputy Staff Director of the U.S. Sentencing Commission; prior to that, he had a distinguished career as a public defender.  Newton is not the only adjunct-practitioner who has forcefully challenged U.S. legal education.  In 2008, Jason Dolin (solo practitioner, adjunct at Capital), published Opportunity Lost: How Law School Disappoints Law Students, the Public, and the Legal Profession.   In 2010, Steve Bennett (partner at Jones Day, adjunct at Fordham) published a law review article entitled, When Will Law Schools Change?

Law professors rarely engage with these critiques; to acknowledge these critiques, some might argue, is to give them oxygen and legitimacy.  I think this approach is a huge mistake.  Any enterprise interested in long-term success cares about the perceptions held by its stakeholders -- and adjuncts are definitely in that group.  In times of crisis, we need friends, not enemies.  Further, Newton, Dolin and Bennett are serious people and very capable lawyers.  If you leaf through these articles, you'll see that they read like Brandeis Briefs against the legal education establishment.  The authors present thoughtful, fact-based, and (albeit occasionally) trenchant arguments on why we, speaking as a legal education insider, should change. 

Simple question:  Can any of us identify a single historical example in which the establishment reformed itself because a critic effectively marshaled facts and logic to reveal the errors of its ways?  Institutional change doesn't happen that way -- facts and logic are no match for a few thousand egos and pious rationalizations for why others should change, but not me.  

The common storyline for institutional change is failure, with the rise of other institutions that better address the social, political and economic needs of stakeholders and broader society.  A less common narrative is institutional adaption, thanks in part to (1) the self-interest and survival instincts, and (2) the serendipity of timely, brilliant leadership.  (Does the legal academy have a few hundred great leaders?)

That said, Newton, Dolin and Bennett may be on the right side of history.  Because of the overproduction of law school graduates and their high levels of debt, we are now at a point when survival for a large proportion of law schools can no longer be taken for granted.  "What cannot go on forever, won't."  Herbert Stein, economist.  

Prediction:  In the next few years, some law schools will change and thrive.  Others won't and they will fail.  There will be nasty recriminations and gnashing of teeth.  A few at the very top will throw dice and decide not to change.  They will survive, but the innovations taking root in the rest of the law school hierarchy will make them look like anachronisms.  It will be a slow decay.  In the meantime, some aspects of the Post-Langdellian paradigm will look a lot like the suggestions made by Newton, Dolin and Bennett.  In twenty years, maybe sooner, the revolution will be over. Finally, Newton et al. will get a must deserved footnote.

[Posted by Bill Henderson]


February 1, 2012 in Current events, Data on legal education, Innovations in legal education, Scholarship on legal education, Structural change | Permalink | Comments (1)